Design, develop, and maintain data pipelines and ETL processes on Databricks .
Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
Optimize data workflows for performance, cost-efficiency, and reliability .
Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
Implement best practices in data governance, security, and quality management.
Mentor junior engineers and provide technical leadership in data engineering best practices.
Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .
Required Skills & Experience
7+ years of experience in Data Engineering .
Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
Strong experience with PySpark , Spark SQL , and Scala .
Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
Proficiency in data modeling, ETL development , and data warehousing concepts.
Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
Strong SQL development skills with a focus on performance tuning .
Experience in implementing CI / CD pipelines for data solutions.
Create a job alert for this search
Sme • vijayapura, rajasthan, in
Related jobs
Promoted
Azure Databricks+Pyspark
Tata Consultancy Servicesvijayapura, rajasthan, in
TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad.
Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show moreLast updated: 18 days ago
Promoted
Azure Databricks
Kumaran Systemsvijayapura, rajasthan, in
We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.
The candidate should be proficient in Dat...Show moreLast updated: 4 days ago
Promoted
Snowflake + DBT Engineer
MindBrainvijayapura, rajasthan, in
Location : Pune — Remote / Hybrid.We are looking for a highly experienced Snowflake + DBT Engineer to architect, build, and optimize modern cloud data platforms.
The ideal candidate should have deep ex...Show moreLast updated: 1 day ago
Promoted
Databricks Data Architect
Tata Consultancy Servicesvijayapura, rajasthan, in
Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e.
Docker, Kubernetes) for deploying data workflows.Should be able ...Show moreLast updated: 18 days ago
Promoted
Databricks Data Engineer Lead – Sustainability Project
Blue Cloud Softech Solutions Limitedvijayapura, rajasthan, in
BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 4 days ago
Promoted
AWS Data Engineer
Tata Consultancy Servicesvijayapura, rajasthan, in
Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 26 days ago
Sky Systems, Inc. (SkySys)vijayapura, rajasthan, in
Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire).
Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show moreLast updated: 3 days ago
Promoted
ETL & Tableau Data Engineer
Magma Consultancyvijayapura, rajasthan, in
ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show moreLast updated: 2 days ago
Promoted
Sr. Data Engineer
HNR Techvijayapura, rajasthan, in
We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show moreLast updated: 11 days ago
Promoted
Data Analyst
KPI Partnersvijayapura, rajasthan, in
The ideal candidate will be highly skilled in.Collect, clean, and transform large datasets from multiple sources using.Build interactive dashboards and analytical models in.Lead digital analytics i...Show moreLast updated: 1 day ago
Promoted
Databricks Engineer
TTC Groupvijayapura, rajasthan, in
We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 2 days ago
Promoted
Senior Data Engineer
Live Connectionsvijayapura, rajasthan, in
Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced.
The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago
Promoted
Sr. Azure Data Architect & Presales Solution
Programmers.iovijayapura, rajasthan, in
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show moreLast updated: 11 days ago
Promoted
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European Careersvijayapura, rajasthan, in
Remote
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 4 days ago
Promoted
Senior Solutions Architect (Data)
Hillview Consulting Solutionsvijayapura, rajasthan, in
If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on.
You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show moreLast updated: 4 days ago
Promoted
Data Solutions Director
Amethyst Partnersvijayapura, rajasthan, in
This role carries both strategic and operational leadership responsibilities, managing Principal Analysts across APAC and working closely with data engineering, development, and global teams.You wi...Show moreLast updated: 1 day ago
Promoted
GCP Data Engineer
Xsell Resourcesvijayapura, rajasthan, in
Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days.
GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 17 days ago
Promoted
Senior Python Data Engineer
iVoyantvijayapura, rajasthan, in
Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show moreLast updated: 5 days ago