This job offer is not available in your country.
Data Engineer – Databricks & Integration Pipelines
Tata Consultancy Servicestamil nadu, tamil nadu, in9 days ago
Job descriptionStrong experience with Azure Databricks (PySpark, Delta Lake). Proficiency in SQL and data modeling . Experience with Azure Data Lake , and Event Hub . Familiarity with data governance and security best practices . Ability to work with large datasets and optimize for performance. Familiarity with CI / CD (Jenkins and Terraform preferred). Knowledge of JSON, XML . Experience with UKG Data Hub or similar HR / payroll data platforms. Knowledge of API integration and microservices . Familiarity with Power BI or other reporting tools.
Role Summary :
We are looking for a Data Engineer with expertise in Azure Databricks , data transformation , and integration pipelines to support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.
Key Responsibilities
- Design and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS, POS) into WFM and UKG.
- Optimize ETL / ELT workflows for performance and scalability.
- Collaborate with Java / API developers to integrate event-driven triggers into data pipelines.
- Implement data quality checks , schema validation, and error handling.
- Support batch and near-real-time data flows for operational and analytics use cases.
- Work with Boomi and WFM teams to ensure data contracts and canonical models are enforced.
Required Skills
Nice-to-Have
Create a job alert for this search
Data Pipeline Engineer • tamil nadu, tamil nadu, in
Related jobs
- Promoted
Senior Big Data Engineer
VeltrisTiruchirappalli, IN Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries.
We specialize in delivering next-gene...Show moreLast updated: 29 days ago
- Promoted
Data Engineering Role
100x.incTiruchirappalli, IN At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 9 days ago
- Promoted
Data Engineer
Sikich IndiaTiruchirappalli, IN Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
- Promoted
Senior Lead Data Engineer
TerraFinn TechnologiesTiruchirappalli, IN TerraFinn Technologies outsources scholars from various top business schools in India and experienced employees to Fintech companies globally.
The company focuses on providing expert employees to he...Show moreLast updated: 8 days ago
- Promoted
Dataiku Engineers
Tiger Analyticstamil nadu, tamil nadu, in Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges.We offer full-stack AI and analytics services & solutions to empower businesse...Show moreLast updated: 9 days ago
- Promoted
Senior Full stack Developer(Dot net+ Angular +SQL)
Programmers.iotiruchirappalli, tamil nadu, in We are looking for a passionate and experienced Senior.NET Core 6, SQL Server, and Selenium-based test automation.The ideal candidate will be responsible for designing, developing, and maintaining ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
R Systemstamil nadu, tamil nadu, in You will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learning at scale.
You'll be a core part of our Data team.This role emphasizes ...Show moreLast updated: 30+ days ago
- Promoted
Databricks Engineer
Tata Consultancy Servicestiruchirappalli, tamil nadu, in Skills : Azure Databricks, Pyspark, ADLS, ADF.Responsibility of / Expectations from the Role : .Designing and building Databricks data pipelines is required.
Experience in transforming the data using A...Show moreLast updated: 7 days ago
- Promoted
Data Engineer
VAANTECHtiruchirappalli, tamil nadu, in Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Namasys Analyticstiruchirappalli, tamil nadu, in Immediate joiners preferred; up to 15 days acceptable.Seeking a Data Engineer to design, build, and maintain scalable data pipelines that automate ingestion and transformation from multiple data so...Show moreLast updated: 9 days ago
- Promoted
Data Engineer
Vriba SolutionsTiruchirappalli, IN Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
Canopus Infosystems - A CMMI Level 3 CompanyTiruchirappalli, IN Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
EveriseTiruchirappalli, IN Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 21 days ago
- Promoted
GCP Big Data Engineer
Talentmaticstiruchirappalli, tamil nadu, in The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 19 days ago
- Promoted
Data Engineer - Web Scraping
Alternative Pathtiruchirappalli, tamil nadu, in Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show moreLast updated: 30+ days ago
- Promoted
Data / ML Engineer
GleantapTiruchirappalli, IN Gleantap is a customer engagement platform powering fitness, wellness, and service businesses.Python (scikit-learn, LightGBM, XGBoost).
Set up retraining and monitoring pipelines (Airflow, MLflow, o...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
HealthyMe AITiruchirappalli, IN We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
INFEC Servicestiruchirappalli, tamil nadu, in Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 18 days ago
- Promoted
Data Engineer
SuperOpstamil nadu, tamil nadu, in We are looking for a Data Engineer to design, build, and maintain scalable data infrastructure that powers analytics, reporting, and AI-driven initiatives.
You will work with modern columnar databas...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Kumaran SystemsTiruchirappalli, IN Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 22 days ago