This job offer is not available in your country.

Lead Data Engineer

ITQube LTDsecunderabad, telangana, in

1 day ago

Job description

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.

The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities :

Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.

Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.

Collaborate on the design of scalable and resilient data architectures in AWS.

Develop and manage infrastructure as code using Terraform.

Actively participate in code reviews and collaborative version control workflows using Git.

Document technical solutions and promote best practices in data engineering.

Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements :

Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models

Large-scale data processing :

Experience with PySpark or Big Data environments – 1–2+ years (preferred)

Familiarity with distributed processing and performance optimization for high-volume data pipelines

AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience

Experience designing ETL workflows using native AWS services

Proactive mindset with a drive to propose and implement improvements

Analytical thinker with the ability to identify bottlenecks and performance issues.

Effective collaborator with both technical teams and non-technical stakeholders

Strong documentation and technical communication skills Nice to have (not mandatory) :

Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design

Familiarity with orchestration tools like Apache

Experience with automated testing for data pipelines

Background in Fintech or experience handling financial datasets

Create a job alert for this search

Lead Data Engineer • secunderabad, telangana, in

Related jobs

Promoted

Lead Data Engineer

Searce IncHyderabad, IN

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 1 day ago

Promoted

Data Engineer

Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India

Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 1 day ago

Promoted

Data Engineer

QualiZealHyderabad, Telangana, India

Job Overview : We are seeking an experienced ETL Developer with 10+ years of expertise in SQL development and database architecture. The ideal candidate should have strong experience in ETL processe...Show moreLast updated: 30+ days ago

Promoted

Data Engineer Team Lead

SGIhyderabad, telangana, in

To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 12 days ago

Promoted

Data Engineer - ETL

TalescopeHyderabad

About the Role : We are looking for a highly experienced and hands-on Data Engineer (AdTech) to lead our analytics team. This role is ideal for some...Show moreLast updated: 19 days ago

Senior Data Engineer - Join our growing community

Xenon7Hyderabad, TS, IN

Quick Apply

Where elite tech talent meets world-class opportunities!.At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

EverestDX IncHyderabad, Telangana, India

Everest DX – We are a Digital Platform Services company, headquartered in Stamford.Our Platform / Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterpri...Show moreLast updated: 1 day ago

Promoted

Data Engineer Lead

Enterprise MindsHyderabad, Telangana, India

We’re Hiring : Data Engineer Lead at Enterprise Minds.Hiring #DataEngineer #Cloud #Azure #AWS #GCP #HyderabadJobs #EnterpriseMinds #Careers]. Lead end-to-end design & deployment of.Collaborate with p...Show moreLast updated: 10 days ago

Senior Data Engineer

Talent WorxHyderabad, TS, IN

Quick Apply

Billion revenue with year-on-year growth of 22% and client retention rate of 120%.Our services include network analytics, payment integrity and optimization, provider credentialing, and provider en...Show moreLast updated: 6 days ago

Promoted

Lead Data Engineer

AnblicksHyderabad, Telangana, India

Location : Hyderabad or Ahmedabad.Skills : Snowflake, Python / Pyspark, SQL.Only Immediate to 15 Days joiners apply.Lead the end-to-end Snowflake platform implementation, including architecture, design...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer- GCP

EgenHyderabad, Telangana, India

We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal candidate will...Show moreLast updated: 27 days ago

Lead Data Engineer

Talent WorxHyderabad, TS, IN

Quick Apply

Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiasti...Show moreLast updated: 6 days ago

Promoted

Lead Data Engineer [T500-20180]

InspireHyderabad, Telangana, India

Inspire Brands is disrupting the restaurant industry through digital transformation and operational efficiencies.The company’s technology hub, Inspire Brands Hyderabad Support Center, India, will l...Show moreLast updated: 23 days ago

AWS Data Engineer RedShift-C2H-TCS

Axiom Software Solutions LimitedHyderabad, TS, IN

Quick Apply

Job Title : AWS Data Engineer - RedShift.Company : Axiom Software Solutions Limited.Location : On-site (as required).Axiom Software Solutions Limited is seeking an AWS Data Engineer with a strong focu...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

Eucloid Data SolutionsHyderabad, IN

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 14 days ago

Promoted

Lead Data Engineer

Saras AnalyticsHyderabad, Telangana, India

We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago

AWS Data Engineer

Talent WorxHyderabad, TS, IN

Quick Apply

We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background i...Show moreLast updated: 5 days ago

Promoted

Data Engineer

Coforgehyderabad, telangana, in

ETL, Azure data factory, Azure Data Bricks, Data Modelling.The ideal candidate will design and maintain scalable data pipelines, ensure data quality and compliance, and support analytics through ro...Show moreLast updated: 13 days ago