Design, develop, and maintain data pipelines and ETL processes on Databricks .
Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
Optimize data workflows for performance, cost-efficiency, and reliability .
Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
Implement best practices in data governance, security, and quality management.
Mentor junior engineers and provide technical leadership in data engineering best practices.
Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .
Required Skills & Experience
7+ years of experience in Data Engineering .
Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
Strong experience with PySpark , Spark SQL , and Scala .
Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
Proficiency in data modeling, ETL development , and data warehousing concepts.
Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
Strong SQL development skills with a focus on performance tuning .
Experience in implementing CI / CD pipelines for data solutions.
Create a job alert for this search
Sme • Lucknow, IN
Related jobs
Azure Databricks+Pyspark
Tata Consultancy Services • Lucknow, IN
TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad.
Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show more
Last updated: 14 days ago • Promoted
Databricks Data Architect
Tata Consultancy Services • lucknow, uttar pradesh, in
Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e.
Docker, Kubernetes) for deploying data workflows.Should be able ...Show more
Last updated: 14 days ago • Promoted
Senior Solutions Architect (Data)
Hillview Consulting Solutions • Lucknow, IN
If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on.
You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
Last updated: 14 hours ago • Promoted • New!
Senior Data Engineer
Veraxion • Lucknow, IN
We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization.
If you love solving complex da...Show more
Last updated: 14 hours ago • Promoted • New!
AI and Databricks
Quantum Integrators • Lucknow, IN
Role : AI and Databricks Engineer.Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers.
Spark, Delta Lake, MLflow, Databr...Show more
Last updated: 14 hours ago • Promoted • New!
Azure + Databricks
PwC India • Lucknow, IN
Job Title : Azure Data Engineer.As a Manager in the Data Engineering practice, you will lead teams and client engagements to design, architect, and deliver enterprise-grade data platforms.You’ll dri...Show more
Last updated: 14 hours ago • Promoted • New!
SAP BW + Databricks,Snowflake
PGC Digital (India) : CMMI Level 3 Company • Lucknow, IN
PGC Digital – PradeepIT Global Consulting Pvt.AI-powered Digital, Cloud, and Talent Solutions.India, Singapore, USA, UK, UAE, and Canada.
We believe storytelling is not just marketing — it’s how peo...Show more
Last updated: 14 hours ago • Promoted • New!
Azure Databricks
Kumaran Systems • Lucknow, IN
We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.
The candidate should be proficient in Dat...Show more
Last updated: 14 hours ago • Promoted • New!
AWS Data Engineer
Tata Consultancy Services • Lucknow, IN
TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show more
Last updated: 14 days ago • Promoted
Data Engineer
Natlov Technologies Pvt Ltd • Lucknow, IN
Hiring : Cloud Data Engineer | Remote | Full-Time | Immediate Joiner.Ltd is looking for a Cloud Data Engineer with strong AWS expertise and working experience in Azure.
In this role, you will design,...Show more
Last updated: 14 hours ago • Promoted • New!
Senior Data Engineer
EXL • Lucknow, IN
Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
Leverage technologies and solutions to innovate with increasingly larg...Show more
Last updated: 30+ days ago • Promoted
AI and Databricks Engineer
Quantum Integrators • Lucknow, IN
Please find the detailed Job Description below : .Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers.Hands-on experienc...Show more
Last updated: 14 hours ago • Promoted • New!
Senior AWS Data Engineer
CYAN360 • Lucknow, IN
Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show more
Last updated: 30+ days ago • Promoted
Sr. Azure Data Architect & Presales Solution
Programmers.io • Lucknow, IN
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
Role : Senior Data Engineer (Python, Spark / Databricks, SQL, AWS).Hybrid (3 days / week in-office).S3, Glue, Redshift, EMR, Lambda.
Strong SQL skills for data transformation and analytics.Expertise in s...Show more
Last updated: 14 hours ago • Promoted • New!
Senior Data Engineer
TekIT Software Solutions Pvt. Ltd. (India & USA) • Lucknow, IN
Job Title : Senior Data Engineer.Kochi / Trivandrum / Bangalore.We are seeking a highly skilled.Spark, Kafka, modern cloud platforms (AWS / GCP / Azure), ETL processes, SQL, and Databricks.The ideal can...Show more
Last updated: 5 days ago • Promoted
Senior Data Architect
Tata Consultancy Services • Lucknow, IN
TCS is a leading global IT services, consulting, and business solutions organization that delivers real results to global businesses, ensuring a level of certainty no other firm can match.TCS is hi...Show more
Last updated: 14 hours ago • Promoted • New!
Data Engineer
One Tapp Consulting • Lucknow, IN
Design and Development : Design, build, and maintain robust, scalable, and optimized ETL / ELT.Python and standard data warehousing principles.
Data Platform Management : Implement and manage data proce...Show more