This job offer is not available in your country.

Lead Data Engineer

ITQube LTDPune, Maharashtra, India

1 day ago

Job description

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.

The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities :

Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.

Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.

Collaborate on the design of scalable and resilient data architectures in AWS.

Develop and manage infrastructure as code using Terraform.

Actively participate in code reviews and collaborative version control workflows using Git.

Document technical solutions and promote best practices in data engineering.

Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements :

Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models

Large-scale data processing :

Experience with PySpark or Big Data environments – 1–2+ years (preferred)

Familiarity with distributed processing and performance optimization for high-volume data pipelines

AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience

Experience designing ETL workflows using native AWS services

Proactive mindset with a drive to propose and implement improvements

Analytical thinker with the ability to identify bottlenecks and performance issues.

Effective collaborator with both technical teams and non-technical stakeholders

Strong documentation and technical communication skills Nice to have (not mandatory) :

Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design

Familiarity with orchestration tools like Apache

Experience with automated testing for data pipelines

Background in Fintech or experience handling financial datasets

Create a job alert for this search

Lead Data Engineer • Pune, Maharashtra, India

Related jobs

Promoted

Lead Aws Data Engineer

ACL DigitalPune, Maharashtra, India

Multi-year work experience as a Platform Lead, Delivery Leader or similar role.Good working knowledge of Aws Services, Python, Pyspark, data modelling. Knowledge of columnar and NoSQL databases, pre...Show moreLast updated: 22 days ago

Promoted

Data Engineer

Kanerika Incpune, maharashtra, in

Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 25 days ago

Lead Data Engineer

LumiqPune, Maharashtra, India

Quick Apply

LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry.We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, t...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Kline + CompanyPune, IN

Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 6 days ago

Promoted

Lead Data Engineer

ACL DigitalPune, Maharashtra, India

Experience : - 10 years to 13 years.Location : Pune,Bangalore,Chennai.Notice Period : - Immediate Joiner only.Experience in Python & pyspark. Experience in ETL Development, ETL pipeline.Experience in Dat...Show moreLast updated: 13 days ago

Promoted

Data Engineer

LuxoftPune, Maharashtra, India

You'll be working in the GM Business Analytics team located in Pune.The successful candidate will be a member of the global Distribution team, which has team members in London and Pune.We work as p...Show moreLast updated: 21 days ago

Promoted

Lead Data Engineer

Eucloid Data SolutionsPune, IN

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 14 days ago

Promoted

Senior Data Engineer

CareerXperts ConsultingPune, IN

We are looking for a highly skilled.The ideal candidate will have strong expertise in modern data engineering tools and frameworks, along with the ability to collaborate closely with data scientist...Show moreLast updated: 2 days ago

Promoted

Lead Big Data Engineer

QualysPune, Maharashtra, India

Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.We are seeking a talented Lead Big Data Engineer to deliver roadmap features of ...Show moreLast updated: 21 days ago

Promoted

Senior Data Engineer

Futran SolutionsPune, Maharashtra, India

Job Description : We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms. The ideal candidate will have a proven track record...Show moreLast updated: 30+ days ago

Promoted

AWS Data Engineer Lead

CoforgePune, Maharashtra, India

We are Hiring : AWS Data Engineer Lead at Coforge Ltd.Interested candidates can share their updated CV at : .The ideal candidate will have a proven track record of designing, building, and maintaining...Show moreLast updated: 1 day ago

Promoted

Lead Data Engineer

Searce IncPune, IN

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 1 day ago

Promoted

Data Engineer

bpPune, Maharashtra, India

Senior Data Engineer will be Responsible for delivering business analysis and consulting activities for the defined specialism using sophisticated technical capabilities, building and maintaining e...Show moreLast updated: 30+ days ago

Promoted

Data Engineer Team Lead

SGIpune, maharashtra, in

To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 12 days ago

Promoted

Senior Data Engineer

InfogainPune, IN

Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

EverisePune, IN

Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 13 days ago

Promoted

Lead Data Engineer - Synapse Analytics

iTechMinds Consulting LLPPune

Job Description : We are seeking a highly skilled Azure Data Engineer to join our dynamic team.As a Data Engineer at LUMIQ, you will play a crucial role in designing...Show moreLast updated: 30+ days ago

Promoted
New!

Data Engineer Lead

CoffeeBeansPune, IN

Hybrid (3 days WFO, 2 days WFH).Tech-lead in one of the feature teams, candidate need to be work along with team lead in handling the team without much guidance. Good communication and leadership sk...Show moreLast updated: 6 hours ago