This job offer is not available in your country.
Lead Data Engineer (3 Days Left)
ITQube LTDPune, Maharashtra, India9 days ago
Job descriptionLooking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services. The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities : Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift. Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability. Collaborate on the design of scalable and resilient data architectures in AWS. Develop and manage infrastructure as code using Terraform. Actively participate in code reviews and collaborative version control workflows using Git. Document technical solutions and promote best practices in data engineering. Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements : Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models Large-scale data processing : Experience with PySpark or Big Data environments – 1–2+ years (preferred) Familiarity with distributed processing and performance optimization for high-volume data pipelines AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience Experience designing ETL workflows using native AWS services Proactive mindset with a drive to propose and implement improvements Analytical thinker with the ability to identify bottlenecks and performance issues. Effective collaborator with both technical teams and non-technical stakeholders Strong documentation and technical communication skills Nice to have (not mandatory) : Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design Familiarity with orchestration tools like Apache Experience with automated testing for data pipelines Background in Fintech or experience handling financial datasets
Create a job alert for this search
Lead Data Engineer • Pune, Maharashtra, India
Related jobs
- Promoted
Data Engineer
VAANTECHpune, maharashtra, in Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
- Promoted
Manager, Data Engineer
Mastercardpune, maharashtra, in Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow.Mastercard is a global technology company in the payments industry.
Our mission is to connect and power...Show moreLast updated: 4 days ago
- Promoted
Data Engineer
The Machine Learning CompanyPune, Maharashtra, India Job Description – Data Engineer (3–5 Years Experience).About The Machine Learning Company (TMLC).AI and Data solutions that drive measurable business impact.
From predictive analytics to intelligent...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
IntraEdgepune, maharashtra, in The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Manuh TechnologiesPune, IN S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer Lead
CoforgePune, Maharashtra, India We are Hiring : AWS Data Engineer Lead at Coforge Ltd.Interested candidates can share their updated CV at : .The ideal candidate will have a proven track record of designing, building, and maintaining...Show moreLast updated: 15 days ago
- Promoted
Data Engineer
InfarsightPune, Maharashtra, India At Infarsight, we simplify complex operations across Finance, HR, Operations, and Supply Chain using platforms like Task Sight, Trip Sight, and Fleet Sight.
Our engineering teams build scalable soft...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
ACL DigitalPune, Maharashtra, India Python - Must have hands-on in Coding.SQL- Must have experience in writing queries.Must have experience in Data Lake / Lakehouse and open formats such as Iceberg, Hudi, Delta Lake" (remove Parquet).M...Show moreLast updated: 30+ days ago
- Promoted
Cloud Data Engineer
Persistent SystemsPune, Maharashtra, India We are seeking cloud data engineers with hands on experience in azure data bricks, data factory, SQL, etc.Job Location : All Persistent Locations.
Job Type : Full Time Employment.Collaborate with prod...Show moreLast updated: 5 days ago
- Promoted
- New!
3 Days Left : Data Engineer Lead
CoffeeBeansPune, Maharashtra, India Experience 5 - 8 yrs Mode of Working Hybrid (3 days WFO, 2 days WFH) Location Bangalore / Pune Roles and responsibilities- - Tech-lead in one of the feature teams, candidate need to be work ...Show moreLast updated: 4 hours ago
- Promoted
Lead Data Engineer
Searce IncPune, IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 15 days ago
- Promoted
Lead Data Engineer
ITQube LTDPune, Maharashtra, India Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 15 days ago
- Promoted
Data Engineer Lead
Calfus Inc.Pune, Maharashtra, India As a Data Engineer – BI Analytics & DWH, you will play a pivotal role in designing and implementing comprehensive business intelligence solutions that empower our organization to make data-driven d...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
OWOWPune, IN Data Architecture & Infrastructure (40%) .Design and implement a multi-database architecture (MongoDB, Redis, Milvus, Neo4j, BigQuery) .
Build scalable data pipelines for real-time conversation proc...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
ITC Infotechpune, maharashtra, in Maintenance and support of Data Pipeline.Data Validation and quality checks.Identify and optimize ingestion pipelines in consultation with Customer.
Investigate Glue job failures and restart.Fix min...Show moreLast updated: 16 days ago
- Promoted
Data Engineer Lead
CoffeeBeansPune, Maharashtra, India Hybrid (3 days WFO, 2 days WFH).Tech-lead in one of the feature teams, candidate need to be work along with team lead in handling the team without much guidance.
Good communication and leadership sk...Show moreLast updated: 12 days ago
- Promoted
Data Engineer
EverisePune, IN Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 27 days ago
- Promoted
Data Engineer
INFEC Servicespune, maharashtra, in Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 25 days ago
- Promoted
Data Engineer
TalogyPune, IN This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer & ML Analyst
Eltropypune, maharashtra, in We’re looking for someone with.Design and manage scalable ETL / ELT pipelines using AWS Glue, Redshift, S3, and Kafka / Kinesis.
Architect and implement data lake and warehouse solutions following best ...Show moreLast updated: 20 days ago