ETL / ELT Engineer
StraiveHyderabad, Republic Of India, IN4 days ago
Job descriptionWrite and optimize complex SQL for ingestion, transformation and consumption layers. Tune Spark jobs for performance and cost : partitioning, join strategies, broadcast, memory / tuning, shuffle reduction. Ensure code quality via unit tests, integration tests, CI / CD and code reviews. Work with data modeling, schema evolution and data quality checks to ensure reliable outputs. Collaborate with platform / DevOps teams to deploy and monitor pipelines (retries, logging, alerting). Troubleshoot production issues and perform root-cause analysis. Mentor and guide junior engineers, share best practices and drive improvements to the data platform. 5–8 years industry experience as a Data Engineer. Strong hands-on experience with Apache Spark 3.X (development, tuning, debugging). Proficient in Scala programming for Spark ETL / ELT development (datasets, RDDs when required). Experience with streaming frameworks like Spark Structured Streaming, Kafka . Proficient in Python programming . Advanced SQL skills (complex queries, window functions, CTEs, query optimization). Experience building production-grade ETL / ELT workflows, testing and monitoring them. Experience with orchestration tools like Apache Airflow Strong software engineering fundamentals : version control (Git), modular code, code reviews, CI / CD pipelines. Experience with cloud object storage and common data formats (Parquet / ORC / Avro). Strong problem solving, communication and collaboration skills. Experience with AWS Glue, EMR, Athena, Redshift, S3 will be a plus.
Key Responsibilities :
- Design, build and maintain scalable batch and (optionally) streaming data pipelines using Apache Spark 3.X, Scala, Python & SQL
- Implement core ETL / ELT logic in Scala and Python;
author efficient Spark DataFrame / Dataset jobs.
Qualifications :
Create a job alert for this search
Engineer • Hyderabad, Republic Of India, IN
Related jobs
![Senior Engineer - ETL [T500-21321]](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobtraffic-in&company_name=ANSR)
- Promoted
Lead ETL ODI
Vienna ConsultancyHyderabad, IN We are seeking a skilled and experienced Data Integration Specialist with over 9 years of experience in designing and developing data solutions using Oracle Data Integrator (ODI).The ideal candidat...Show moreLast updated: 5 days ago
- Promoted
Senior Etl Developer
Mount Talent Consulting Pvt Ltd.Hyderabad, Republic Of India, IN In this role you will be part of a team working to develop solutions enabling the business to leverage data as an asset at the bank.
As a Lead ETL Developer, you will be leading teams to develop, ma...Show moreLast updated: 30+ days ago
- Promoted
Etl Developer
Vastika IncHyderabad, Republic Of India, IN Summary We are looking for highly skilled Data Engineers with 3 to 5 years of experience in building and managing advanced data solutions.
The ideal candidate should have extensive experience with S...Show moreLast updated: 2 days ago
- Promoted
ETL Developer, Senior Associate
State Street CorporationHyderabad, India Charles River Development (CRD) is the FinTech division of State Street.Together with State Street's Middle and Back-office services, Charles River's cloud-based Front Office technology forms the f...Show moreLast updated: 4 days ago
- Promoted
Senior ETL Developer
ValueMomentumHyderabad, Telangana, India Role : Sr ETL Developer – IBM CP4D.Primary skills : ETL, IBM CP4D (Cloud Pak for Data) Secondary skills : AWS S3, Unix Scripting, Oracle SQL.
We are looking for a skilled ETL CP4D Developer to design, ...Show moreLast updated: 18 days ago
- Promoted
Senior Engineer - Etl T500-21321
ANSRHyderabad, Republic Of India, IN ANSR is hiring for one of its clients.To Care for People on Life's Journey®.Together with our American Eagle regional partners, we offer thousands of flights daily to more than 350 destinations in ...Show moreLast updated: 15 days ago
- Promoted
ETL Developer
Vastika IncHyderabad, Telangana, India Summary We are looking for highly skilled Data Engineers with 3 to 5 years of experience in building and managing advanced data solutions.
The ideal candidate should have extensive experience with S...Show moreLast updated: 2 days ago
- Promoted
ETL Developer
Pinnacle Group, Inc.Hyderabad, IN PTR Global is a leader in providing innovative workforce solutions, dedicated to optimizing talent acquisition and management processes.
Our commitment to excellence has earned us the trust of busin...Show moreLast updated: 30+ days ago
- Promoted
ETL Test Engineer
PalTechHyderabad, Telangana, India Data Warehouse (DWH) / ETL Test Engineer Overview : We are seeking a highly motivated and skilled Data Warehouse (DWH) / ETL Test Engineer with 3 to 6 years of experience to join our data team.The...Show moreLast updated: 4 days ago
- Promoted
Etl Lead
MOURI TechHyderabad, Republic Of India, IN Looking for Senior ETL Testing.Notice period : Immediate to 30 Days Max.Over 7 years of experience in Functional Testing, ETL Testing, Data Warehouse Testing, and SQL-based Testing.Experience in Fun...Show moreLast updated: 3 days ago
- Promoted
ETL Test Engineer
Tata Consultancy Serviceshyderabad, telangana, in NOTE : Relevant experience in ETL must 7 years.SQL - Expert level of knowledge in core concepts of SQL and query, Informatica, Talend and Ab initio, BI concepts - OLAP vs OLTP, Data warehouse and da...Show moreLast updated: 30+ days ago
- Promoted
ETL Lead
MOURI TechHyderabad, Telangana, India Looking for Senior ETL Testing Exp Level : 7+ Years Location : Hyd, Bang, Vizag Mode of work : Hybrid Notice period : Immediate to 30 Days Max - Over 7 years of experience in Functional Testing, E...Show moreLast updated: 3 days ago
- Promoted
Senior ETL Developer
Mount Talent Consulting Pvt Ltd.Hyderabad, Telangana, India In this role you will be part of a team working to develop solutions enabling the business to leverage data as an asset at the bank.
As a Lead ETL Developer, you will be leading teams to develop, ma...Show moreLast updated: 30+ days ago
- Promoted
ETL Developer
Tata Consultancy ServicesHyderabad, Telangana, India TCS has been a great pioneer in feeding the fire of Young techies like you.We are global leaders in the technology arena and there's nothing that can stop us from growing together.Noida, Pune, Hyde...Show moreLast updated: 30+ days ago
- Promoted
Senior Etl Developer
ValueMomentumHyderabad, Republic Of India, IN Role : Sr ETL Developer – IBM CP4D.Primary skills : ETL, IBM CP4D (Cloud Pak for Data) Secondary skills : AWS S3, Unix Scripting, Oracle SQL.
We are looking for a skilled ETL CP4D Developer to design, ...Show moreLast updated: 18 days ago
- Promoted
ETL Testing with Databricks (Hyderabad and Chennai Only)
Tata Consultancy ServicesHyderabad, Telangana, India TCS has been a great pioneer in feeding the fire of young Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of ...Show moreLast updated: 18 days ago
- Promoted
Snowflakes with ETL
Tata Consultancy ServicesHyderabad, Telangana, India Snowflakes with ETL Greetings from TCS!! ! TCS has been a great pioneer in feeding the fire of young Techies like you.We are a global leader in the technology arena and there’s nothing that can s...Show moreLast updated: 28 days ago
- Promoted
Senior Engineer - ETL [T500-21321]
ANSRHyderabad, Telangana, India ANSR is hiring for one of its clients.To Care for People on Life's Journey®.Together with our American Eagle regional partners, we offer thousands of flights daily to more than 350 destinations in ...Show moreLast updated: 15 days ago