Design, develop, and maintain data pipelines and ETL processes on Databricks .
Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
Optimize data workflows for performance, cost-efficiency, and reliability .
Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
Implement best practices in data governance, security, and quality management.
Mentor junior engineers and provide technical leadership in data engineering best practices.
Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .
Required Skills & Experience
7+ years of experience in Data Engineering .
Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
Strong experience with PySpark , Spark SQL , and Scala .
Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
Proficiency in data modeling, ETL development , and data warehousing concepts.
Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
Strong SQL development skills with a focus on performance tuning .
Experience in implementing CI / CD pipelines for data solutions.
Create a job alert for this search
Sme • pushkar, gujarat, in
Related jobs
Promoted
Azure Databricks
Kumaran SystemsPushkar, IN
We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.
The candidate should be proficient in Dat...Show moreLast updated: 2 days ago
Promoted
New!
Azure Databricks Specialist
KPI PartnersPushkar, IN
KPI Partners are seeking highly skilled and experienced Senior Data Engineers to join our dynamic team at KPI, working on challenging and multi-year data transformation projects for our clients.Thi...Show moreLast updated: 4 hours ago
Promoted
New!
Senior Azure Data Engineer
Tata Consultancy ServicesAjmer, IN
Job Title : Senior Azure Data Engineer.Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL.
Good Knowledge of Data Brick lakehouse and Azure ...Show moreLast updated: 10 hours ago
Promoted
New!
Senior Data Engineer
MindlancePushkar, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 10 hours ago
Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire).
Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show moreLast updated: 1 day ago
Promoted
New!
AWS data engineer
Tata Consultancy ServicesPushkar, IN
TCS is looking for AWS data engineer.Location : Kolkata, Hyderabad, Bangalore, Chennai, Pune, Gurgaon.Strong hands-on experience with AWS Data Services : .
Amazon S3, Glue, Redshift, Athena, Kinesis, E...Show moreLast updated: 10 hours ago
Promoted
Data Engineer
Alp Consulting Ltd.Pushkar, IN
Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 30+ days ago
Promoted
New!
Senior Data Engineer
TEKsystems Global Services in IndiaPushkar, IN
Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL.
Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 10 hours ago
Promoted
New!
Senior DataOps Engineer (AWS)
MSBC GroupAjmer, IN
Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 10 hours ago
Promoted
Senior Data Engineer
DonyatiAjmer, IN
We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 2 days ago
Promoted
New!
AWS Data Engineer
People Prime WorldwidePushkar, IN
Important Note (Please Read Before Applying).You have less than 8 years or more than 10 years of total experience.You do NOT have strong Python + AWS Data Engineering experience.You are NOT hands-o...Show moreLast updated: 10 hours ago
Promoted
Data Engineer
IntraEdgeAjmer, IN
Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
Promoted
New!
C++ SME
Career Soft Solutions Pvt. Ltd.Ajmer, IN
Define the technical vision and architecture, ensuring scalability, reliability, and efficiency.Lead efforts in query optimization, indexing strategies, and efficient data partitioning for distribu...Show moreLast updated: 4 hours ago
Promoted
Sr. Azure Data Architect & Presales Solution
Programmers.ioAjmer, IN
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show moreLast updated: 2 days ago
Promoted
Azure Databricks+Pyspark
Tata Consultancy ServicesPushkar, IN
TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad.
Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show moreLast updated: 16 days ago
Promoted
Senior Solutions Architect (Data)
Hillview Consulting SolutionsAjmer, IN
If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on.
You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show moreLast updated: 2 days ago
Promoted
Data Engineer
DigitalzonePushkar, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 16 days ago
Promoted
New!
Databricks Engineer
TTC GroupAjmer, IN
We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 10 hours ago