Senior Data Engineer
Straivechennai, tamil nadu, in30+ days ago
Job description5-8 years of experience as a Data Engineer . Strong hands-on experience with Apache Spark 3.x . Proficient in Scala, Python, and advanced SQL . Experience with streaming frameworks (e.g., Spark Structured Streaming, Kafka). Knowledge of orchestration tools (e.g., Apache Airflow). Experience with cloud platforms like AWS Glue, EMR, Athena, Redshift, and S3 is a plus. Solid understanding of software engineering fundamentals (Git, CI / CD).
Job Summary
We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver data products, and mentoring junior engineers.
Key Responsibilities
- Design and build data pipelines using Apache Spark 3.x, Scala, Python, and SQL .
- Tune Spark jobs for performance and cost.
- Ensure code quality with unit tests, CI / CD, and code reviews.
- Collaborate with platform and DevOps teams to deploy and monitor pipelines.
- Troubleshoot production issues and perform root-cause analysis.
Qualifications
Create a job alert for this search
Senior Data Engineer • chennai, tamil nadu, in
Related jobs
- Promoted
Senior Data Engineer
Eucloid Data SolutionsChennai, Tamil Nadu, India Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
DonyatiChennai, IN We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer
MastekChennai, Tamil Nadu, India We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 14 days ago
- Promoted
Senior Data Engineer
SGS & CoChennai, Tamil Nadu, India Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show moreLast updated: 15 days ago
- Promoted
Senior Data Engineer
HealthyMe AIChennai, IN We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
- Promoted
AWS Senior Data Engineer
Tata Consultancy ServicesChennai, Tamil Nadu, India TCS is Hiring of AWS Senior Data Engineer Experience : 5 - 10 Yrs Location : Chennai Mode of Interview : Virtual Technical Skill Set - 10 + years of Overall experience in AWS Cloud Technologies -...Show moreLast updated: 3 days ago
- Promoted
Senior Data Engineer
Incept Labs, Inc.chennai, tamil nadu, in Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer (Snowflake+ DBT)
Anblickschennai, tamil nadu, in Senior Data Engineer (Snowflake + dbt).Hyderabad / Ahmedabad (Hybrid).Great Place to Work® Certified | Snowflake Elite Partner.
We are looking for a highly skilled.ELT pipelines and analytical data ...Show moreLast updated: 2 days ago
- Promoted
- New!
Senior Data Engineer
EXLchennai, India Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
Leverage technologies and solutions to innovate with increasingly larg...Show moreLast updated: 12 hours ago
- Promoted
Senior Data Engineer
Dexian IndiaChennai, Tamil Nadu, India Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
High proficiency in Python, ...Show moreLast updated: 2 days ago
- Promoted
Azure Senior Data Engineer
Tata Consultancy ServicesChennai, Tamil Nadu, India We await your innovation at TCS : Hiring |Azure Senior Data Engineers|.Required Experience : 5-10 years.Data Pipeline Development : Design, build, and optimize scalable data pipelines using Azure Data...Show moreLast updated: 29 days ago
- Promoted
Senior Data Engineer
PoshmarkChennai, Tamil Nadu, India Senior Software Engineer - Data Engineering.Big Data team is a central player in the Poshmark organization.Our goal is to democratize data, support exploding business, build data and ML pipelines t...Show moreLast updated: 28 days ago
- Promoted
Senior AWS Data Engineer
CYAN360Chennai, IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
IntelliasChennai, IN Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 15 days ago
- Promoted
- New!
Senior Data Engineer (AWS / GCP)
Armakunimount, India We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results.If you are a tea...Show moreLast updated: 18 hours ago
- Promoted
Senior Data Engineer
CYGNVSChennai, Tamil Nadu, India Our company culture is a perfect blend of productivity and enjoyment, prioritizing the growth and development of our talented employees as part of a high-achieving team.
We are in search of exceptio...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
SAIVA AIChennai, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
CYGNVS - Senior Data Engineer
CYGNVS INDIA PRIVATE LIMITEDChennai Description : CYGNVS is a purpose-built, first-of-its-kind guided cyber crisis platform designed to allow users to prepa...Show moreLast updated: 10 days ago