Senior Data EngineerStraive • tirunelveli, tamil nadu, in
Senior Data Engineer
Straive • tirunelveli, tamil nadu, in
30+ days ago
Job description5-8 years of experience as a Data Engineer . Strong hands-on experience with Apache Spark 3.x . Proficient in Scala, Python, and advanced SQL . Experience with streaming frameworks (e.g., Spark Structured Streaming, Kafka). Knowledge of orchestration tools (e.g., Apache Airflow). Experience with cloud platforms like AWS Glue, EMR, Athena, Redshift, and S3 is a plus. Solid understanding of software engineering fundamentals (Git, CI / CD).
Job Summary
We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver data products, and mentoring junior engineers.
Key Responsibilities
- Design and build data pipelines using Apache Spark 3.x, Scala, Python, and SQL .
- Tune Spark jobs for performance and cost.
- Ensure code quality with unit tests, CI / CD, and code reviews.
- Collaborate with platform and DevOps teams to deploy and monitor pipelines.
- Troubleshoot production issues and perform root-cause analysis.
Qualifications
Create a job alert for this search
Senior Data Engineer • tirunelveli, tamil nadu, in
Related jobs
The ideal candidate will have a strong foundation in.Job Title : Azure Data Engineer.Work Timings : 5 : 00 PM to 2 : 00 AM IST.
If your expertise is primarily in.Lead the migration of large-scale SQL work...Show more
Lead Data Engineer
Guidanz Inc • tirunelveli, tamil nadu, in
BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
Last updated: 1 day ago • Promoted
Senior Software Engineer
Programmers.io • tirunelveli, tamil nadu, in
Senior AI-Integrated Software Engineer (.Remote until office reopens, Work from Home.We are looking for a dynamic and innovative.
The ideal candidate will bring hands-on experience in AI-assisted de...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Sicame GBS • tirunelveli, tamil nadu, in
At Sicame Global Business Support (GBS), we are the dynamic support platform of the Sicame Group, operating across 5 continents and supporting over 50 companies in 26 countries.From business analys...Show more
Last updated: 6 hours ago • Promoted • New!
Sr Azure Data Engineer - Remote work
techolution • tirunelveli, tamil nadu, in
Remote
Last updated: 30+ days ago • Promoted
AI Data Engineer
Turing • tirunelveli, tamil nadu, in
We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models ...Show more
Last updated: 1 day ago • Promoted
Contract- Snowflake Data Engineer with Data Vault (Snowpark or CortexAI)
KPG99 INC • tirunelveli, tamil nadu, in
Role Snowflake-focused Data Engineer.Location : Offshore Remote (India).Project involves implementing Data Vault 2.Work includes specific pipeline development in Snowflake with Streamlit.Not a tradi...Show more
Last updated: 2 hours ago • Promoted • New!
ThoughtSpot Engineer
Insight Global • tirunelveli, tamil nadu, in
BI / reporting tools such as ThoughtSpot, Tableau, or Power BI.Proficiency in SQL and understanding of data modeling concepts.
Demonstrated ability to build complex dashboards and reports that drive b...Show more
Last updated: 2 hours ago • Promoted • New!
Freelance Data Engineer - SQL, C#, React, and Data Performance Optimization
ThreatXIntel • tirunelveli, tamil nadu, in
ThreatXIntel is a startup cyber security company dedicated to protecting businesses and organizations of all sizes from evolving cyber threats.
Offering services such as cloud security, web and mobi...Show more
Last updated: 6 hours ago • Promoted • New!
Azure Data Engineer
Paritas Recruitment • tirunelveli, tamil nadu, in
Azure Data Engineer - 6 Month+ Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking an experienced and...Show more
Last updated: 1 day ago • Promoted
Data Analytics Engineer
Cube Consultancy Services • tirunelveli, tamil nadu, in
We are seeking a skilled and motivated Data Analytics Engineer to join our growing data.This role is ideal for someone with a strong foundation in SQL, experience using Sigma.Computing, and a deep ...Show more
Last updated: 2 hours ago • Promoted • New!
Data Engineer
ShimentoX Technologies • tirunelveli, tamil nadu, in
Data Engineer (Strong with Building data connectors).Key Skills : Python, Data Connectors, Metadata, API Integration-Rest / GraphQL.
Must have proven background in building data connectors.Experience s...Show more
Last updated: 1 day ago • Promoted
Freelance Data Quality Engineer
Leading MNC • tirunelveli, tamil nadu, in
Freelance Data Quality Engineer.The candidate should have a minimum of 8+ yrs.If you're looking for freelance / part time opportunity (along with your day job) & a chance to work with the top 0.You ...Show more
Last updated: 29 days ago • Promoted
Freelance GCP Data Engineer - Apache NiFi & SQL Expert
ThreatXIntel • tirunelveli, tamil nadu, in
ThreatXIntel is a startup specializing in cybersecurity, offering tailored and cost-effective solutions for businesses and organizations of all sizes.
Our expertise spans cloud security, web and mob...Show more
Last updated: 2 hours ago • Promoted • New!
Data Engineer
Quess IT Staffing • tirunelveli, tamil nadu, in
Lead the design and implementation of scalable data pipelines for ingesting, transforming, and activating customer data.Develop and orchestrate workflows using Apache Airflow and Spark.S3, Glue, At...Show more
Last updated: 2 hours ago • Promoted • New!
Data Engineer
EXL • tirunelveli, tamil nadu, in
The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
Last updated: 30+ days ago • Promoted
GCP Data Engineer
Adastra • tirunelveli, tamil nadu, in
We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
Last updated: 16 days ago • Promoted
Azure DevOps Data Engineer
Paritas Recruitment • tirunelveli, tamil nadu, in
Azure DevOps (Data) Engineer - 6+ Month Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking a skilled...Show more
Last updated: 1 day ago • Promoted
Freelance Azure Data Engineer - Vectr & Cribl Expert
ThreatXIntel • tirunelveli, tamil nadu, in
ThreatXIntel is a startup cyber security company focused on empowering businesses and organizations to defend against evolving cyber threats.
Offering a comprehensive suite of services, including cl...Show more
Last updated: 2 hours ago • Promoted • New!