Senior Databricks Engineer
Newscape ConsultingDelhi, India2 days ago
Job descriptionCollaborate with data architects to design data lakehouse and warehouse solutions. Implement data quality frameworks, versioning, and governance standards (e.g., Unity Catalog). Optimize Spark jobs, cluster configurations, and query performance. Cloud & Infrastructure : Work with Azure Databricks or AWS to configure and manage cloud-based data platforms. Develop and manage CI / CD pipelines for Databricks notebooks, workflows, and jobs. Implement security best practices for data access, encryption, and compliance. Partner with data scientists, analysts, and product teams to enable data-driven decisions. Provide technical mentorship to junior engineers. Contribute to strategic planning and architecture reviews. Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field. 6+ years of experience in data engineering or software development. 4+ years hands-on experience with Databricks and Apache Spark. Strong proficiency in Python, SQL, and PySpark. Experience with Delta Lake, Data Lakehouse, and Data Warehousing concepts. Solid understanding of data modeling, ETL design, medallion architecture and distributed data processing. Familiarity with CI / CD tools (Azure DevOps, GitHub Actions, Jenkins, etc.). Cloud platform expertise in Azure, AWS, or GCP. Experience with machine learning pipelines in Databricks (MLflow). Knowledge of data governance and compliance frameworks. Experience integrating Databricks with BI tools like Power BI, Tableau, or Looker. Certifications such as : Databricks Certified Data Engineer Associate or Professional Azure Data Engineer Associate AWS Big Data Specialty Strong problem-solving and analytical thinking. Excellent communication and collaboration abilities. Proactive mindset with ownership of deliverables. Passion for learning emerging data technologies. Work with cutting-edge data technologies on large-scale projects. Opportunity to shape the organization’s data strategy and architecture. Collaborative and innovative culture focused on continuous growth.
About the Role
We are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data ecosystems to power business insights and AI / ML initiatives.
Key Responsibilities
Design &
- Development :
- Build and maintain scalable ETL / ELT data pipelines using Apache Spark and Databricks.
- Develop Delta Lake architectures and optimize data storage for performance and cost.
- Automate data ingestion, transformation, and orchestration processes across multiple data sources.
- Build different stages of medallion architecture such as Bronze, Silver and Gold layer
Data Architecture & Modeling :
Collaboration & Leadership :
Required Qualifications
Preferred Qualifications
Soft Skills
Why Join Us
Create a job alert for this search
Senior Engineer • Delhi, India
Related jobs
- Promoted
Data Engineer – Azure & AWS
Yoda TechDelhi, IN We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms.
The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 12 days ago
- Promoted
Data Engineer
Canopus Infosystems - A CMMI Level 3 CompanyDelhi, IN Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer
TerraGiGDelhi, IN Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 14 days ago
- Promoted
Senior Data Engineer
IntelliasMeerut, IN Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 3 days ago
- Promoted
Senior AWS Data Engineer_Exp : 5+ Years
Atyeti Incgurgaon, haryana, in Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Philodesign Technologies IncDelhi, IN The ideal candidate will have strong hands-on expertise in.Azure Data Factory (ADF), Synapse, and Databricks.ETL, SQL, and data warehousing concepts.
Design, develop, and implement ETL solutions usi...Show moreLast updated: 2 days ago
- Promoted
AWS Databricks + Mongo DB ( Full-time at a Fortune 500 tech MNC )
HARPDelhi, IN The ideal candidate will have strong hands-on experience in.Knowledge of DevOps practices and containerization tools is a plus.
Develop and maintain scalable data pipelines for large-scale data proc...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer
SAIVA AIMeerut, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladenew delhi, delhi, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Insight GlobalDelhi, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Straivegurugram, uttar pradesh, in The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Guidanz IncDelhi, IN BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 3 days ago
- Promoted
Senior Data Engineer with AWS_ Exp : 6+ Years
Atyeti IncMeerut, IN Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago
- Promoted
Senior Snowflake Data Engineer
iVoyantMeerut, IN One of our clients is looking for an experienced Senior Snowflake Data Engineer to join their team.We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering a...Show moreLast updated: 3 days ago
- Promoted
Data Engineer
IntraEdgeDelhi, IN We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Masteknoida, delhi, in We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
HealthyMe AIMeerut, IN We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
SGS & Conarela, delhi, in Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show moreLast updated: 3 days ago