){kind=logo}
Role: Senior Lead Data Engineer
Position: Contract
Location: India (remote)
Duration: 6 months
Role Overview
We have an exciting opportunity for a highly experienced Senior / Lead Data Engineer to join a growing data practice. The successful candidate will bring 10+ years of hands-on Data Engineering experience, with deep expertise in Databricks, Azure Data Factory (ADF), and Python scripting. This is both a technical and leadership role, requiring the ability to design and build enterprise-grade data platforms while leading and mentoring a team of 8–10 Data Engineers across complex delivery programmes.
Key Responsibilities
• Lead the end-to-end design, development, and delivery of scalable data pipelines and platforms on Databricks and Azure.
• Own the technical direction for ingestion, transformation, and curation workloads using ADF, Databricks (PySpark/Spark SQL), and Python.
• Line-manage or technically lead a team of 8–10 Data Engineers, including task allocation, code reviews, mentoring, and performance feedback.
• Define and enforce engineering best practices covering coding standards, CI/CD, testing, observability, and data quality.
• Partner with architects, analysts, and business stakeholders to translate requirements into robust, production-ready data solutions.
• Optimise performance, cost, and reliability of existing data pipelines and Databricks workloads.
• Drive adoption of Lakehouse, Delta Lake, and Unity Catalog patterns across the estate.
• Contribute to roadmap planning, estimation, and resource planning across multiple concurrent workstreams.
• Act as the senior technical escalation point for complex engineering challenges.
Essential Skills & Experience
• 10+ years of hands-on experience in Data Engineering, delivering enterprise-scale data platforms.
• Strong, recent hands-on experience with Databricks (PySpark, Spark SQL, Delta Lake, workflows, cluster tuning).
• Solid expertise in Azure Data Factory (ADF) — pipeline design, orchestration, triggers, parameterisation, and integration patterns.
• Advanced Python scripting skills for data processing, automation, and tooling.
Proven track record of leading Data Engineering teams of 8–10 engineers in a senior or lead capacity.
• Strong SQL skills and deep understanding of data modelling (dimensional, Data Vault, Lakehouse/medallion).
• Experience with CI/CD for data (Azure DevOps, GitHub Actions) and Infrastructure as-Code (Terraform, ARM/Bicep).
• Comfortable working across the wider Azure data stack (ADLS Gen2, Synapse, Key Vault, Event Hub, Azure Functions).
• Excellent stakeholder engagement and communication skills, with the ability to translate technical concepts for non-technical audiences.
Desirable Experience
• Databricks certifications (Data Engineer Associate/Professional) or Azure Data Engineer certification (DP-203 / DP-700).
• Experience with Unity Catalog, data governance, and lineage tooling (Purview, Collibra).
• Exposure to streaming data (Kafka, Event Hubs, Structured Streaming).
• Experience working in regulated industries (financial services, healthcare, public sector).
• Prior consulting or professional services background.
Senior Lead Data Engineer • kurnool, India
We are seeking a skilled and motivated Data Engineer with hands-on experience in Databricks and Airflow to join our Engineering team.The ideal candidate will be responsible for designing, building,... Show more
We are looking for a QA Lead Engineer who can provide both technical leadership and hands-on programming expertise to drive the testing strategy and quality assurance for our data and analytics ini... Show more
Objectways Technologies is looking for an experienced Data Engineer to join our Enterprise Data & AI Platform team.You'll design and build scalable data pipelines on GCP, working on data migration,... Show more
Python, FastAPI, and Azure‑based data platforms.Build and maintain cloud‑native data pipelines on.Develop ETL/ELT workflows using.Python, Azure Data Factory (ADF), Databricks (PySpark).GenAI, ML tr... Show more
The company fosters innovation, collaboration, and continuous learning, enabling teams to work on cutting-edge data platforms and enterprise-scale systems.We are seeking a highly skilled.Data Engin... Show more
We are looking for a highly skilled and motivated Data Engineer with strong expertise in AWS data services to join our data platform team.The ideal candidate will have hands-on experience designing... Show more
Exciting Opportunity Alert! 🌟 HTC Global Services is hiring Data Engineer – SAP Data sphere & ETL Developer for an Airline Project.HTC Global Services - a leading CMM level 5 global provider of in... Show more
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de... Show more
SAI Creative World is a trusted IT services and consulting firm specializing in delivering innovative technology solutions for business success.From custom software development and cloud solutions ... Show more
As a Senior Data Engineer your role will be pivotal to evolving our existing data and reporting experiences.You’ll build out pipelines to gather data from multiple sources and make it available for... Show more
Full-Time Contract (40hrs/week).Pune, India (Hybrid 2 days/week onsite).We are looking for a Senior Data Engineer with strong experience in Snowflake, Azure, and modern data platforms, along with e... Show more
We are seeking a skilled Data Engineer to architect, build, and optimise scalable data platforms on cloud infrastructure.The role involves close collaboration with cross-functional teams to deliver... Show more
We are looking for a seasoned Data Engineer with strong expertise in GCP, Kafka, and PySpark, along with proven experience in leading teams or driving technical initiatives.The ideal candidate will... Show more
As a Senior Staff Software/Data Engineer, you will collaborate closely with the data engineering team and work on.You will get a chance to work with brilliant minds in the industry, work on complex... Show more
Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution.We leverage deep technical expertise, Agil... Show more
EazyML, Recognized by Gartner, EazyML (www.Our solutions facilitate proactive compliance and sustainable automation and The company is associated with breakthrough startups like Amelia.This is a fu... Show more
Data Engineer - Palantir Foundry, Workshop, AI Analytics, Pyspark & Typescript.Fully Remote - Long Term (initially 6-9 months) full time contract.We have an immediate requirement for an experienced... Show more
We are looking for a hands-on, senior Databricks Architect to design, build, and govern our Lakehouse data platform from the ground up.You will own the end-to-end architecture of our data infrastru... Show more
We're searching for the architects of the audacious & the pioneers of the possible.If you're the type to dismantle assumptions, re-engineer ‘best practices,’ and build solutions that make the futur... Show more
Exciting Opportunity Alert! 🌟 HTC Global Services is hiring Senior Azure Data Engineer (ADF, Databricks, PySpark) for one of our premium projects.The ideal candidate should have hands-on expertise... Show more
){kind=logo}
