Talent.com
2892- Databricks Engineer

2892- Databricks Engineer

EXLPune, Maharashtra, India
20 days ago
Job description

About the Role

We are seeking a highly skilled Databricks Engineer with 5–7 years of experience in data engineering and analytics. The ideal candidate will have strong expertise in designing, developing, and optimizing large-scale data pipelines and solutions using Databricks, Spark, and cloud platforms. This role requires a combination of strong technical skills, problem-solving abilities, and hands-on experience with modern data architectures.

Key Responsibilities

  • Design, develop, and maintain data pipelines and ETL / ELT processes using Databricks and Apache Spark.
  • Build and optimize Delta Lake-based data architectures for scalable and reliable analytics.
  • Implement data ingestion, transformation, and processing frameworks from structured and unstructured sources.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
  • Ensure data quality, governance, and security across all platforms and solutions.
  • Optimize performance, cost-efficiency, and scalability of Databricks workloads.
  • Work with cloud platforms for data storage, compute, and orchestration.
  • Implement CI / CD pipelines, testing frameworks, and MLOps practices for Databricks projects.
  • Troubleshoot issues and provide production support for Databricks environments.

Required Skills & Experience

  • 5–7 years of experience in data engineering, with at least 2–3 years of Databricks hands-on experience.
  • Strong expertise in Apache Spark (PySpark / Scala / SQL) and distributed data processing.
  • Solid experience with Delta Lake, Lakehouse architecture, and data modeling.
  • Hands-on experience with at least one cloud platform : Azure Data Lake, AWS S3, or GCP BigQuery / Storage.
  • Strong proficiency in SQL for data manipulation and performance tuning.
  • Experience with ETL frameworks, workflow orchestration tools (Airflow, ADF, DBX Workflows).
  • Good understanding of CI / CD, Git-based workflows, and DevOps practices.
  • Exposure to MLOps and MLflow is a strong plus.
  • Knowledge of data governance, cataloging, and security frameworks.
  • Create a job alert for this search

    Engineer • Pune, Maharashtra, India

    Related jobs
    • Promoted
    Staff Engineer Software-Browser Development

    Staff Engineer Software-Browser Development

    Palo Alto NetworksPune / Pimpri-Chinchwad Area, India
    At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Database Developer

    Senior Database Developer

    Ixceed SolutionsPune
    About the Role : We are seeking a highly skilled Senior Database Developer to join our team on a contractual basis.The ideal candidate wil...Show moreLast updated: 30+ days ago
    • Promoted
    Database Developer - Redshift / PostgreSQL

    Database Developer - Redshift / PostgreSQL

    Ixceed SolutionsPune
    Job Description : We are seeking an experienced Database Developer with deep expertise in Amazon Redshift and PostgreSQL to support our data infrastructure and analy...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Big Data Engineer - PySpark / Scala

    Senior Big Data Engineer - PySpark / Scala

    Consulting PanditsPune
    Exciting Job Opportunity in Pune! Are you an experienced Senior Big Data Engineer with over 5 years of expertise? We have a fantastic opportunity waiting for you!<...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Information TechnologyPune
    Big Data Engineer Key Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets.C...Show moreLast updated: 30+ days ago
    • Promoted
    Tableau Developer

    Tableau Developer

    Persistent SystemsPune, Maharashtra, India
    About Position We are seeking a skilled Tableau Developer to design, develop, and maintain interactive dashboards and reports that transform complex data into meaningful business insights.The idea...Show moreLast updated: 16 days ago
    • Promoted
    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Tata Consultancy ServicesPune, Maharashtra, India
    Relevant Experience (in Yrs) : .Hyderabad, Pune, Chennai, Bangalore, Noida.Technical / Functional Skills Must Have Experience in : . Hands on experience in Spark, Scala and Pyspark.Should be proficient i...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    WorkiFicientPune
    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and...Show moreLast updated: 30+ days ago
    • Promoted
    Reveille Technologies - Big Data Engineer

    Reveille Technologies - Big Data Engineer

    Reveille TechnologiesPune
    Description : We are looking for highly skilled and motivated Big Data Engineers / Leads to join our team and drive the development of our next-generation data plat...Show moreLast updated: 28 days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Persistent SystemsPune, Maharashtra, India
    About Position : We are seeking data bricks engineer with hands on experience in Power BI, python, spark and data bricks. Role : Databricks Engineer - Location : Pune & Mumbai - Experience : 8 to 12 Ye...Show moreLast updated: 18 days ago
    • Promoted
    Senior Cloud Database Engineer

    Senior Cloud Database Engineer

    XequalstoPune
    Role : Cloud Database Administrator (Cloud DBA- L3) Location : Mumbai / Navi Mumbai- Hybrid (Pune candidates can travel) About the Role : ...Show moreLast updated: 20 days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    Leinex ConsultingPune
    Role & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders < / p&...Show moreLast updated: 30+ days ago
    • Promoted
    Softpath Technologies - Senior Big Data Engineer - Hive & Unix Scripting

    Softpath Technologies - Senior Big Data Engineer - Hive & Unix Scripting

    Softpath Technologies LLCPune
    Description : Job Title : Senior Big Data Engineer Hive & Unix Scripting Location : P...Show moreLast updated: 4 days ago
    • Promoted
    Lead Big Data Engineer - Spark

    Lead Big Data Engineer - Spark

    QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune
    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.Description : We are seeking a talented Lead Big ...Show moreLast updated: 30+ days ago
    • Promoted
    Tableau Developer

    Tableau Developer

    ConfidentialPune, Maharashtra, India
    Job Title : Tableau Developer Experience : 6 Years Location : Pune Immediate Joiner Preferred Job Overview : We are seeking an experienced Tableau Developer with 6 years of expertise in data visualiza...Show moreLast updated: 20 days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    CoforgePune, Maharashtra, India
    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills : - AWS, Spark & Scala.Experience Required : 3 to 6 Years. Job Locations : Pune, Hyderabad, Greater Noida Only.For queri...Show moreLast updated: 19 days ago
    • Promoted
    Tableau Developer

    Tableau Developer

    Mobile Programming LLCPune
    Position : Tableau Developer Experience : 3 to 6 years Locations : Mumbai, Pune, Gurgaon, Panchkula, Mohali Notice Period : Immediate ...Show moreLast updated: 30+ days ago
    • Promoted
    MongoDB Developer

    MongoDB Developer

    CRESCENDO GLOBAL LEADERSHIP HIRING INDIA PRIVATE L IMITEDPune
    About the Role : We are looking for an experienced MongoDB Developer with 7- 9 years of hands-on expertise to join our growing team. This role requires deep knowledge ...Show moreLast updated: 30+ days ago