This job offer is not available in your country.
Senior Data Engineer
Straivetirunelveli, tamil nadu, in20 days ago
Job description5-8 years of experience as a Data Engineer . Strong hands-on experience with Apache Spark 3.x . Proficient in Scala, Python, and advanced SQL . Experience with streaming frameworks (e.g., Spark Structured Streaming, Kafka). Knowledge of orchestration tools (e.g., Apache Airflow). Experience with cloud platforms like AWS Glue, EMR, Athena, Redshift, and S3 is a plus. Solid understanding of software engineering fundamentals (Git, CI / CD).
Job Summary
We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver data products, and mentoring junior engineers.
Key Responsibilities
- Design and build data pipelines using Apache Spark 3.x, Scala, Python, and SQL .
- Tune Spark jobs for performance and cost.
- Ensure code quality with unit tests, CI / CD, and code reviews.
- Collaborate with platform and DevOps teams to deploy and monitor pipelines.
- Troubleshoot production issues and perform root-cause analysis.
Qualifications
Create a job alert for this search
Senior Data Engineer • tirunelveli, tamil nadu, in
Related jobs
Thinkgrid Labs is at the forefront of innovation and technology.Our expert team of software engineers, architects, and UI / UX designers specialises in crafting bespoke web, mobile, cloud application...Show moreLast updated: 23 days ago
)
- Promoted
Senior Data Engineer
The Mastermind GroupThoothukudi, IN Remote (India) – Occasional travel to Riyadh, KSA.Sunday–Thursday preferred (9 AM – 5 PM IST).About The Mastermind Group (TMG).
Software Asset Management (SAM).Hardware Asset Management (HAM).We're ...Show moreLast updated: 30+ days ago
- Promoted
Fabric Platform Data Architect (Remote)
Thinkgrid LabsThoothukudi, INRemote
- Promoted
Data Engineer
XebiaThoothukudi, IN We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early.
Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 21 days ago
- Promoted
Data Engineer
RevXThoothukudi, IN RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
- Promoted
Data Architect
Infogainthoothukudi, tamil nadu, in Design, develop, and optimize scalable data pipelines and workflows using Databricks and Apache Spark on AWS.Collaborate with data scientists, analysts, and other stakeholders to transform data int...Show moreLast updated: 20 days ago
- Promoted
Data Architect
Mindfire SolutionsThoothukudi, IN We are seeking a highly skilled and strategic Data Architect to design, develop, and manage the organisation’s data architecture.
The ideal candidate will ensure that data assets are structured, int...Show moreLast updated: 11 days ago
- Promoted
Data Engineering Role
100x.inctirunelveli, tamil nadu, in At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 10 days ago
- Promoted
Data Architect
Tata Consultancy Servicestirunelveli, tamil nadu, in Greetings from TCS Human Resources Team!!!.Years of experience : 8 to 10 Years.Airflow • : Data pipeline orchestration.Data Form & DBT • : Data architecture and modeling.
Architecture Design • : Scalable d...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Data Engineer
RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS)tirunelveli, tamil nadu, in This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company.
If you’re someone who takes initiative, val...Show moreLast updated: 20 hours ago
- Promoted
Data Architect
G10XThoothukudi, IN Senior Data Architect (15+ Years Experience).We are looking for a seasoned Data Architect to lead and shape enterprise-wide data initiatives.
This role requires a strategic leader with deep technica...Show moreLast updated: 16 days ago
- Promoted
Data Engineer
Kumaran SystemsThoothukudi, IN Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 23 days ago
- Promoted
Data Engineer
The Transformation Grouptirunelveli, tamil nadu, in The ideal candidate should possess experience with ETL, data and reporting; and contributing code to deliver new features and functionality.
Day-to-day you will collaborate with engineers, product m...Show moreLast updated: 11 days ago
- Promoted
Data Engineer - Web Scraping
Alternative PathThoothukudi, IN Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
IntraEdgeThoothukudi, IN The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Sikich IndiaThoothukudi, IN Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
- Promoted
- New!
GCP Data Architect
Tata Consultancy Servicestirunelveli, tamil nadu, in Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 20 hours ago
- Promoted
Principal / Senior Data Architect
AaysThoothukudi, IN Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Vriba SolutionsThoothukudi, IN Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show moreLast updated: 11 days ago
- Promoted
Senior Data Engineer
SAIVA AIThoothukudi, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 23 days ago
- Promoted
Data Engineer
EveriseThoothukudi, IN Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 22 days ago