Design, develop, and maintain data pipelines and ETL processes on Databricks .
Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
Optimize data workflows for performance, cost-efficiency, and reliability .
Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
Implement best practices in data governance, security, and quality management.
Mentor junior engineers and provide technical leadership in data engineering best practices.
Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .
Required Skills & Experience
7+ years of experience in Data Engineering .
Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
Strong experience with PySpark , Spark SQL , and Scala .
Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
Proficiency in data modeling, ETL development , and data warehousing concepts.
Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
Strong SQL development skills with a focus on performance tuning .
Experience in implementing CI / CD pipelines for data solutions.
Create a job alert for this search
Sme • pune, maharashtra, in
Related jobs
Promoted
Data Engineer
IntraEdgePune, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
Promoted
Databricks Data Engineer Lead – Sustainability Project
Blue Cloud Softech Solutions LimitedPune, IN
BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 1 day ago
Promoted
Azure Databricks+Pyspark
Tata Consultancy ServicesPune, IN
TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad.
Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show moreLast updated: 16 days ago
Promoted
PySpark Databricks Engineer - SQL / Azure
Confidential CompanyPune
Primary Tech skills : AZURE ,Databricks ,Pyspark, SQL Secondary Tech skills : ADF, Synapse Job Description : Show moreLast updated: 30+ days ago
Promoted
Sr. Azure Data Architect & Presales Solution
Programmers.ioPune, IN
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show moreLast updated: 1 day ago
Promoted
Infocepts - Senior Data Engineer - Azure Databricks
InfoCepts Technologies Pvt. Ltd.Pune
Description : Key Responsibilities : Data Pipeline Development : - Design and ...Show moreLast updated: 30+ days ago
Promoted
New!
Azure Databricks Architect
Spot Your Leaders & Consulting LLPPune
Role : Databricks Architect - Lead architecture, design, and implementation of data lakehouse solutions using Databricks, Delta Lake, Unity Catalog, and Apache Spark.Define an...Show moreLast updated: 3 hours ago
Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire).
Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show moreLast updated: 17 hours ago
Promoted
New!
Senior Data Architect
Tata Consultancy ServicesPune, Maharashtra, India
TCS is a leading global IT services, consulting, and business solutions organization that delivers real results to global businesses, ensuring a level of certainty no other firm can match.TCS is hi...Show moreLast updated: 17 hours ago
Promoted
New!
AI and Databricks Engineer
Quantum IntegratorsPune, Maharashtra, India
Please find the detailed Job Description below : .Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers.Hands-on experienc...Show moreLast updated: 17 hours ago
Promoted
SAP Datasphere Developer
Quantum IntegratorsPune, Maharashtra, India
Role : SAP Datasphere Developer.Location : Pune / Nagpur, Maharashtra (Work From Office, Hybrid can be done).Job Type : Full-time with Quantum Integrators.
SAP with 1-2 experience in building and impleme...Show moreLast updated: 30+ days ago
Promoted
AWS Data Engineer - ETL / Data Pipeline
Ixceed SolutionsPune
AWS Data Engineer Location : Pune Min years of experience : 7 Years Budget : &...Show moreLast updated: 30+ days ago
Promoted
Azure Databricks
Kumaran SystemsPune, IN
We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.
The candidate should be proficient in Dat...Show moreLast updated: 1 day ago
Promoted
Databricks Data Engineer
AscendionPune, Maharashtra, India
Job Title : Senior Data Engineer.Location : Gurgaon / Pune / Bangalore.Skills : PySpark, SQL, Databricks, AWS.The ideal candidates should have hands-on expertise in building.
Databricks and AWS, along w...Show moreLast updated: 30+ days ago
Promoted
STIBO MDM Developer
Akshaya IT Business solutionsPune
Description : - Design, develop, and implement Stibo STEP solutions based on business requirements.Configure and custom...Show moreLast updated: 2 days ago
Promoted
New!
Dashboard Developer – BI & Data Modeling (Pune, Mumbai, or Bangalore)
KPG99 INCpune, maharashtra, in
Dashboard Developer – BI & Data Modeling.Location : Remote – preferably in Pune, Mumbai, or Bangalore, India.Tableau and / or Power BI, including dashboard creation and deployment.Strong proficiency i...Show moreLast updated: 15 hours ago
Promoted
AI and Databricks
Quantum IntegratorsPune, Maharashtra, India
Role : AI and Databricks Engineer Location : Pune / Nagpur : : WFO Duration : Fulltime Job Description : - Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthrop...Show moreLast updated: 1 day ago
Promoted
Data Engineer
Tata Consultancy Servicespune, maharashtra, in
Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago