Databricks SMEDataE2E Technologies • Lucknow, IN
No longer accepting applications
Databricks SME
DataE2E Technologies • Lucknow, IN
2 days ago
Job description7+ years of experience in Data Engineering . Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow). Strong experience with PySpark , Spark SQL , and Scala . Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus). Proficiency in data modeling, ETL development , and data warehousing concepts. Solid understanding of big data ecosystems (Hadoop, Kafka, etc.). Strong SQL development skills with a focus on performance tuning . Experience in implementing CI / CD pipelines for data solutions.
Salary - Upto 25 LPA
Key Responsibilities
- Design, develop, and maintain data pipelines and ETL processes on Databricks .
- Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
- Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
- Optimize data workflows for performance, cost-efficiency, and reliability .
- Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
- Implement best practices in data governance, security, and quality management.
- Mentor junior engineers and provide technical leadership in data engineering best practices.
- Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .
Required Skills & Experience
Create a job alert for this search
Sme • Lucknow, IN
Related jobs
)
Azure Databricks+Pyspark
Tata Consultancy Services • Lucknow, IN
TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad.
Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show more
Last updated: 16 days ago • Promoted
Databricks Data Architect
Tata Consultancy Services • lucknow, uttar pradesh, in
Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e.
Docker, Kubernetes) for deploying data workflows.Should be able ...Show more
Last updated: 16 days ago • Promoted
Senior Solutions Architect (Data)
Hillview Consulting Solutions • Lucknow, IN
If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on.
You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
Last updated: 1 day ago • Promoted
AWS Data Engineer
Tata Consultancy Services • lucknow, uttar pradesh, in
Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more
Last updated: 24 days ago • Promoted
Senior Data Platform Engineer
Black Dog Labs • Lucknow, IN
Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps.
We’re looking for a hands-on Senior Data Platform...Show more
Last updated: 30+ days ago • Promoted
Azure Databricks
Kumaran Systems • Lucknow, IN
We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.
The candidate should be proficient in Dat...Show more
Last updated: 1 day ago • Promoted
Databricks Data Engineer Lead – Sustainability Project
Blue Cloud Softech Solutions Limited • Lucknow, IN
BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
Last updated: 1 day ago • Promoted
Data Modeler
Stratus • Lucknow, IN
Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks.
Experience with Agile development methodologies and tools, such as Jira, t...Show more
Last updated: 8 days ago • Promoted
Senior AWS Data Engineer
CYAN360 • Lucknow, IN
Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show more
Last updated: 30+ days ago • Promoted
Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)
Sky Systems, Inc. (SkySys) • Lucknow, IN
Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire).
Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show more
Last updated: 19 hours ago • Promoted • New!
Senior Data Engineer
SAIVA AI • Lucknow, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Senior DataOps Engineer (AWS)
MSBC Group • Lucknow, IN
Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show more
Last updated: less than 1 hour ago • Promoted • New!
AWS Data Architect
ACL Digital • Lucknow, IN
AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices.
.AWS Certified Solutions Architect preferred.Show more
Last updated: 6 days ago • Promoted
Data Engineer
IntraEdge • Lucknow, IN
Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
Last updated: 30+ days ago • Promoted
Senior Azure Data Engineer
Tata Consultancy Services • Lucknow, IN
Job Title : Senior Azure Data Engineer.Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL.
Good Knowledge of Data Brick lakehouse and Azure ...Show more
Last updated: less than 1 hour ago • Promoted • New!
Azure Databricks Admin
Greymatter Innovationz • Lucknow, IN
Greymatter Innovationz helps you stay digitally relevant across domains, technologies, and skillsets, every day.Location : Anywhere in India / Bangalore preferred.
Databricks Platform Support and capa...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Donyati • Lucknow, IN
We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
Last updated: 1 day ago • Promoted
Senior Oracle Data Engineer
Strattek Consulting • Lucknow, IN
This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs.
Exposure to Oracle FDI (Fusion Data Intel...Show more
Last updated: 1 day ago • Promoted