No longer accepting applications

Lead Data Engineer

ITQube LTDhyderabad, India

11 days ago

Job description

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.

The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities :

Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.

Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.

Collaborate on the design of scalable and resilient data architectures in AWS.

Develop and manage infrastructure as code using Terraform.

Actively participate in code reviews and collaborative version control workflows using Git.

Document technical solutions and promote best practices in data engineering.

Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements :

Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models

Large-scale data processing :

Experience with PySpark or Big Data environments – 1–2+ years (preferred)

Familiarity with distributed processing and performance optimization for high-volume data pipelines

AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience

Experience designing ETL workflows using native AWS services

Proactive mindset with a drive to propose and implement improvements

Analytical thinker with the ability to identify bottlenecks and performance issues.

Effective collaborator with both technical teams and non-technical stakeholders

Strong documentation and technical communication skills Nice to have (not mandatory) :

Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design

Familiarity with orchestration tools like Apache

Experience with automated testing for data pipelines

Background in Fintech or experience handling financial datasets

Create a job alert for this search

Lead Data Engineer • hyderabad, India

Related jobs

Promoted

Lead Data Engineer

Saras AnalyticsHyderabad, Telangana, India

We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

OptumHyderabad, Telangana, India

Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions. Utilize knowledge of variou...Show moreLast updated: 17 days ago

Promoted

Data Engineer

PRUDENT GLOBALTECH SOLUTIONS PRIVATE LIMITEDHyderabad

Description : Job Summary : Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage ...Show moreLast updated: 26 days ago

Promoted

Data Engineer

Tanla Platforms LimitedHyderabad, Telangana, India

We are seeking a skilled Data Engineer with 5–10 years of experience to join our dynamic Data Engineering team.The ideal candidate will design, build, and optimize large-scale data pipelines and wa...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

S&P GlobalHyderabad, Telangana, India

This job is with S&P Global, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.About the Rol...Show moreLast updated: 1 day ago

Promoted

Data Engineer - ETL

TalescopeHyderabad

About the Role : We are looking for a highly experienced and hands-on Data Engineer (AdTech) to lead our analytics team. This role is ideal for some...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

thinkbridgehyderabad, India

We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 9 days ago

Promoted

Data Engineer

Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India

Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 28 days ago

Promoted

Data Engineer – Databricks Platform

Amicon Hub ServicesHyderabad, Telangana, India

Proven experience in Databricks (Delta Lake, Spark, PySpark, SQL).Strong expertise in data integration from multiple sources (SQL Server, MongoDB, InfluxDB). Hands-on experience with ETL / ELT pipelin...Show moreLast updated: 7 days ago

Promoted

Data Engineer

RecroHyderabad, India

Configure, deploy, and maintain Quantexa software on cloud platforms such as AWS, Azure, or Google Cloud.Design, implement, and optimize data pipelines and integration workflows within the Qua...Show moreLast updated: 30+ days ago

Promoted

Data Analytics Engineer - ETL

Prudential Manpower GroupHyderabad

Mode of Work : : 5-10 : : 2 PM - 11 PM Job Summary : Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

EXLHyderabad, Telangana, India

Job Summary : We are seeking an experienced Data Engineer with strong expertise in AWS cloud services and Databricks to design and implement scalable, high-performance data pipelines.The role ...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Veraxionhyderabad, India

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 7 days ago

Promoted

Egen - Lead Data Engineer - Google Cloud Platform

SPRINGML INDIA DEVELOPMENT CENTER PRIVATE LIMITEDHyderabad

Job Overview : We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Response InformaticsHyderabad, Telangana, India

AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 17 days ago

Promoted
New!

Data Engineer

Thermo Fisher ScientificHyderabad, Telangana, India

This job is with Thermo Fisher Scientific, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly...Show moreLast updated: 11 hours ago

Promoted

EverestDX - Data Engineer - ETL / Spark

EverestDXHyderabad

Job Purpose : As a Data Engineer - ETL / Spark, you will be responsible for designing, developing, and maintaining data integration workflows and pipelines.You will wor...Show moreLast updated: 30+ days ago

Promoted

Tech Lead - Data Engineer

RecroHyderabad, Telangana, India

Data Engineering and Analytics team.The ideal candidate will be responsible for configuring, deploying, and maintaining Quantexa software on leading cloud platforms while leveraging their expertise...Show moreLast updated: 9 days ago