Senior Data EngineerStraive • tirunelveli, tamil nadu, in
Senior Data Engineer
Straive • tirunelveli, tamil nadu, in
30+ days ago
Job description5-8 years of experience as a Data Engineer . Strong hands-on experience with Apache Spark 3.x . Proficient in Scala, Python, and advanced SQL . Experience with streaming frameworks (e.g., Spark Structured Streaming, Kafka). Knowledge of orchestration tools (e.g., Apache Airflow). Experience with cloud platforms like AWS Glue, EMR, Athena, Redshift, and S3 is a plus. Solid understanding of software engineering fundamentals (Git, CI / CD).
Job Summary
We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver data products, and mentoring junior engineers.
Key Responsibilities
- Design and build data pipelines using Apache Spark 3.x, Scala, Python, and SQL .
- Tune Spark jobs for performance and cost.
- Ensure code quality with unit tests, CI / CD, and code reviews.
- Collaborate with platform and DevOps teams to deploy and monitor pipelines.
- Troubleshoot production issues and perform root-cause analysis.
Qualifications
Create a job alert for this search
Senior Data Engineer • tirunelveli, tamil nadu, in
Related jobs
The ideal candidate will have a strong foundation in.Job Title : Azure Data Engineer.Work Timings : 5 : 00 PM to 2 : 00 AM IST.
If your expertise is primarily in.Lead the migration of large-scale SQL work...Show more
Lead Data Engineer
Guidanz Inc • tirunelveli, tamil nadu, in
BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
Last updated: 23 hours ago • Promoted
Senior Software Engineer
Programmers.io • tirunelveli, tamil nadu, in
Senior AI-Integrated Software Engineer (.Remote until office reopens, Work from Home.We are looking for a dynamic and innovative.
The ideal candidate will bring hands-on experience in AI-assisted de...Show more
Last updated: 30+ days ago • Promoted
Senior Full Stack Engineer
Black Piano • Tirunelveli, Tamil Nadu, India
Your Role Lead development of software applications across client portfolio with a focus on MERN or MEAN frameworks within an Azure, AWS or GCP environment.
Lead the continuous development of bespok...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Sicame GBS • tirunelveli, tamil nadu, in
At Sicame Global Business Support (GBS), we are the dynamic support platform of the Sicame Group, operating across 5 continents and supporting over 50 companies in 26 countries.From business analys...Show more
Last updated: 3 hours ago • Promoted • New!
Sr Azure Data Engineer - Remote work
techolution • tirunelveli, tamil nadu, in
Remote
Last updated: 30+ days ago • Promoted
AI Data Engineer
Turing • tirunelveli, tamil nadu, in
We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models ...Show more
Last updated: 23 hours ago • Promoted
Generative AI Engineer
Avensys Consulting UK • Tirunelveli, Tamil Nadu, India
Role : Gen AI Engineer Location : Remote Contract : 06 Months Rate : 450-500 GBP Per Day – Inside IR35 MAX The Gen AI Engineer will be a specialized type of artificial intelligence professional, focus...Show more
Last updated: 20 hours ago • Promoted • New!
Freelance Data Engineer - SQL, C#, React, and Data Performance Optimization
ThreatXIntel • tirunelveli, tamil nadu, in
ThreatXIntel is a startup cyber security company dedicated to protecting businesses and organizations of all sizes from evolving cyber threats.
Offering services such as cloud security, web and mobi...Show more
Last updated: 3 hours ago • Promoted • New!
Senior Software Engineer
Insight Global • tirunelveli, tamil nadu, in
Senior Software Engineer – System Integration.The ideal candidate will have expertise in.You will act as a hands-on contributor, delivering solutions to meet project goals and timelines.Design, dev...Show more
Last updated: 23 hours ago • Promoted
Generative AI Engineer
Philodesign Technologies Inc • tirunelveli, tamil nadu, in
Gen AI Engineer – Remote | 6+ Years Experience.We are seeking a highly skilled.AI / ML and Generative AI solutions.The ideal candidate will have practical expertise in.
RAG pipelines, agent workflows,...Show more
Last updated: 23 days ago • Promoted
Azure Data Engineer
Paritas Recruitment • tirunelveli, tamil nadu, in
Azure Data Engineer - 6 Month+ Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking an experienced and...Show more
Last updated: 23 hours ago • Promoted
Data Engineer
ShimentoX Technologies • tirunelveli, tamil nadu, in
Data Engineer (Strong with Building data connectors).Key Skills : Python, Data Connectors, Metadata, API Integration-Rest / GraphQL.
Must have proven background in building data connectors.Experience s...Show more
Last updated: 23 hours ago • Promoted
Freelance Data Quality Engineer
Leading MNC • tirunelveli, tamil nadu, in
Freelance Data Quality Engineer.The candidate should have a minimum of 8+ yrs.If you're looking for freelance / part time opportunity (along with your day job) & a chance to work with the top 0.You ...Show more
Last updated: 29 days ago • Promoted
Data Engineer
EXL • tirunelveli, tamil nadu, in
The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
Last updated: 30+ days ago • Promoted
AI Applications Engineer
Linksoft Technologies • tirunelveli, tamil nadu, in
Position : AI Applications Engineer.We’re building agentic AI apps for real business use—voice / chat agents that orchestrate workflows across CRMs / ERPs and internal tools.
You’ll help us shipfeatures ...Show more
Last updated: 23 hours ago • Promoted
Azure DevOps Data Engineer
Paritas Recruitment • tirunelveli, tamil nadu, in
Azure DevOps (Data) Engineer - 6+ Month Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking a skilled...Show more
Last updated: 23 hours ago • Promoted
Senior Software Engineer
Turing • tirunelveli, tamil nadu, in
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.Turing support...Show more
Last updated: 3 hours ago • Promoted • New!
Sr. Azure Data Architect & Presales Solution
Programmers.io • tirunelveli, tamil nadu, in
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
Last updated: 23 days ago • Promoted