Design, develop, and maintain data pipelines and ETL processes on Databricks .
Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
Optimize data workflows for performance, cost-efficiency, and reliability .
Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
Implement best practices in data governance, security, and quality management.
Mentor junior engineers and provide technical leadership in data engineering best practices.
Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .
Required Skills & Experience
7+ years of experience in Data Engineering .
Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
Strong experience with PySpark , Spark SQL , and Scala .
Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
Proficiency in data modeling, ETL development , and data warehousing concepts.
Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
Strong SQL development skills with a focus on performance tuning .
Experience in implementing CI / CD pipelines for data solutions.
Create a job alert for this search
Sme • Anand, IN
Related jobs
Lead Data Engineer
Ironbook AI • Nadiad, IN
We are seeking an experienced and driven Lead Data Engineer to spearhead the.AI use cases across the organization.Minimum 7 years of experience in data engineering, with at.Strong hands-on experien...Show more
Last updated: 17 hours ago • Promoted • New!
Senior Oracle Data Engineer
Strattek Consulting • Nadiad, Gujarat, India
Role Summary We are seeking an experienced Senior Data Engineer with hands-on mastery in Oracle Data Integrator (ODI) and deep understanding of ETL and ELT frameworks.This role centers on arch...Show more
Last updated: 16 days ago • Promoted
ThoughtSpot Engineer
Insight Global • nadiad, gujarat, in
BI / reporting tools such as ThoughtSpot, Tableau, or Power BI.Proficiency in SQL and understanding of data modeling concepts.
Demonstrated ability to build complex dashboards and reports that drive b...Show more
Last updated: 17 hours ago • Promoted • New!
Data Engineering Manager – Web Crawling & Pipeline Architecture (2 to 7yrs)
AIMLEAP • Anand, Gujarat, India
Data Engineering Manager – Web Crawling & Pipeline Architecture Experience : 7 to 12 Years Location : Remote / Bangalore Engagement : Full-time Positions : 2 Qualification : B.Tech / MCA / Compute...Show more
Last updated: 18 hours ago • Promoted • New!
Data Engineer (Snowflake + Databricks)
MyRemoteTeam Inc • nadiad, gujarat, in
MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent.We empower businesses by providing world-class software engineers, operations suppo...Show more
Last updated: 13 hours ago • Promoted • New!
Senior Data Engineer
Ironbook AI • Anand, IN
The ideal candidate will have strong experience with cloud platforms, modern ETL / ELT tools, and deep technical skills in Python, SQL, and distributed data frameworks.
Design, develop, and maintain s...Show more
Last updated: 17 hours ago • Promoted • New!
Lead Data Engineer
Guidanz Inc • Anand, IN
BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
Last updated: 1 day ago • Promoted
Data Engineer (DOMO & Python / Kafka)
Smart Moves Consultants • Nadiad, IN
We are looking for candidates with strong Domo and Python / Kafka connect experience.Please find the JD below and share suitable and strong profiles at the earliest.
Design, build, and maintain scala...Show more
Last updated: 3 days ago • Promoted
Sr. Azure Data Architect & Presales Solution
Programmers.io • Anand, IN
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
Last updated: 16 days ago • Promoted
Senior Data Engineer
Donyati • Anand, Gujarat, India
Senior Data Engineer Job Title : Senior Data Engineer Location : Remote / Willing to Travel Job Type : Full-time Experience Level : 8+ years About the Role : We are seeking a highly skilled Senior ...Show more
Last updated: 16 days ago • Promoted
Senior Data Engineer - Data Acquisition
InfoBeans • Nadiad, Gujarat, India
About the Job We are seeking a highly skilled Senior Data Engineer – Data Acquisition (ODS) to join our data engineering team.
The ideal candidate will have extensive hands-on experience in buildi...Show more
Last updated: 23 days ago • Promoted
Data Engineer
IntraEdge • Nadiad, IN
Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
Last updated: 30+ days ago • Promoted
Senior Solutions Architect (Data)
Hillview Consulting Solutions • Anand, IN
If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on.
You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
Last updated: 16 days ago • Promoted
Azure Databricks
Kumaran Systems • Nadiad, Gujarat, India
Dear Candidates Greeting, We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.The candidate...Show more
Last updated: 16 days ago • Promoted
AWS Data Architect
ACL Digital • Anand, IN
AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices.
.AWS Certified Solutions Architect preferred.Show more
Last updated: 21 days ago • Promoted
Lead Data Engineer
Confidential • nadiad, gujarat, in
Expertise in big data technologies such as Apache Spark and real-time streaming technologies like Apache Kafka.Strong programming skills in Python, Java, C++, SQL etc.
Advanced knowledge of a major ...Show more
Last updated: 13 hours ago • Promoted • New!
Semarchy Developer Lead (MDM)
Mastech Digital • Anand, IN
Remote with quarterly visit to Chennai office.Ability to Identify and analyze business requirements, functional design and translate requirements to technical specifications, MDM workflow configura...Show more
Last updated: 30+ days ago • Promoted
MLOps Engineer — AWS SageMaker
Hadron Talent -Hadronfinsys • Nadiad, IN
MLOps Engineer — AWS SageMaker.A large global enterprise (name not disclosed).Full-time / Long-term contract.You will work within a global data & analytics team to design, deploy, and maintain robu...Show more