Talent.com
This job offer is not available in your country.
Senior Databricks Engineer - Python / SQL / Scala

Senior Databricks Engineer - Python / SQL / Scala

ConfidentialPune
30+ days ago
Job description

We are seeking a proactive Senior Databricks Engineer to design, implement, and optimize data processing pipelines on the Databricks platform. You will be responsible for architecting scalable data solutions, collaborating with cross-functional teams to migrate existing solutions, and ensuring the reliability and performance of our data infrastructure. This role requires deep expertise in Databricks and strong programming skills in Python, SQL, or Scala.

Roles & Responsibilities :

  • Design and develop data processing pipelines and analytics solutions using Databricks .
  • Architect scalable and efficient data models and storage solutions on the Databricks platform.
  • Collaborate with architects and other teams to migrate current solutions to use Databricks.
  • Optimize the performance and reliability of Databricks clusters and jobs to meet business requirements.
  • Use best practices for data governance, security, and compliance on the Databricks platform.
  • Mentor junior engineers and provide technical guidance.
  • Stay current with emerging technologies and trends in data engineering and analytics to drive continuous improvement.

Skills Required :

  • Proficiency in programming languages such as Python, Scala, or SQL .
  • Strong understanding of distributed computing principles and experience with big data technologies like Apache Spark .
  • Experience with cloud platforms such as AWS, Azure, or GCP , and their associated data services.
  • Proven track record of delivering scalable and reliable data solutions in a fast-paced environment.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills with the ability to work effectively in cross-functional teams.
  • Experience with containerization technologies like Docker and Kubernetes is a plus.
  • Knowledge of DevOps practices for automated deployment and monitoring of data pipelines is a plus.
  • QUALIFICATION :

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Skills Required

    Python, Scala, Sql, Apache Spark, Aws, Azure, Docker

    Create a job alert for this search

    Senior Engineer • Pune

    Related jobs
    • Promoted
    Staff Data Platform Engineer

    Staff Data Platform Engineer

    ZendeskVadgaon (Vadgaon Budruk), India
    Our Enterprise Data & Analytics (EDA) is looking for an experienced Staff Data Platform Engineer to join our growing Platform engineering team. You’ll work in a collaborative Agile environment...Show moreLast updated: 19 days ago
    • Promoted
    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent HealthPune
    Responsibilities : - Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Arch...Show moreLast updated: 22 days ago
    • Promoted
    TripleLift - Senior Data Engineer - Python / SQL

    TripleLift - Senior Data Engineer - Python / SQL

    TripleLiftPune
    About TripleLift : We're TripleLift, an advertising platform on a mission to elevate digital advertising through beautiful creative, quality publishers, actionab...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesPune, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Zinnia - Data Engineer III - Python / SQL

    Zinnia - Data Engineer III - Python / SQL

    ZinniaPune
    Who You Are : As a seasoned Data Engineer specializing in data engineering, you bring extensive expertise in optimizing data workflows using various database tools l...Show moreLast updated: 14 days ago
    • Promoted
    PySpark Databricks Engineer - SQL / Azure

    PySpark Databricks Engineer - SQL / Azure

    Confidential CompanyPune
    Primary Tech skills : AZURE ,Databricks ,Pyspark, SQL Secondary Tech skills : ADF, Synapse Job Description : Show moreLast updated: 16 days ago
    • Promoted
    AWS Data Engineer - Python / SQL / ETL

    AWS Data Engineer - Python / SQL / ETL

    DeqodePune
    Profile : AWS Data Engineer Mandate Skills : AWS + Databricks + Pyspark + SQL role Location : Bangalore ...Show moreLast updated: 6 days ago
    • Promoted
    Intellias - Senior Data Engineer - Python Programming

    Intellias - Senior Data Engineer - Python Programming

    IntelliasPune
    Why Work at Intellias ? At Intellias, we are more than just a technology company - we are a trusted partner to some of the worlds most prestigious organizations.With ...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer - PySpark

    Senior Data Engineer - PySpark

    Xlr8 Talent SearchPune
    Job Description : We are looking for a Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and distributed computing to develop ...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - PySpark / SQL

    Big Data Engineer - PySpark / SQL

    PRONEXUS CONSULTING PRIVATE LIMITEDPune
    About the Role : We are seeking a highly skilled Senior Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines and platforms.T...Show moreLast updated: 14 days ago
    • Promoted
    Celebal Technologies - Data Engineer - Python / SQL

    Celebal Technologies - Data Engineer - Python / SQL

    Celebal TechnologiesPune
    Responsibilities : Platform Expertise : - Act as a trusted advisor by leveraging in-depth knowledge of the Databricks Platfo...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Engineer - Azure Databricks

    Senior Data Engineer - Azure Databricks

    Arting DigitalPune
    Data Engineer (Databricks) Experience : 5+ Years Location : Pune / Ahmedabad Show moreLast updated: 19 days ago
    • Promoted
    ETL Senior Engineer

    ETL Senior Engineer

    TESTQ Technologies LimitedPune
    About the Role : We are looking for a highly skilled ETL Senior Engineer with AWS expertise to design, build, and optimize robust data pip...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer - Python / SQL

    Data Engineer - Python / SQL

    VIPANY GLOBAL SOLUTIONS PRIVATE LIMITEDPune
    Responsibilities for Data Engineer : - Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet function...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL Digitalpune, maharashtra, in
    Python - Must have hands-on in Coding.SQL- Must have experience in writing queries.Must have experience in Data Lake / Lakehouse and open formats such as Iceberg, Hudi, Delta Lake" (remove Parquet).M...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - ETL / Python

    Senior Data Engineer - ETL / Python

    Synapse Tech Services IncPune
    About the Role : We are looking for a highly experienced Senior Data Engineer with deep expertise in the AWS ecosystem to design, implemen...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer - Python

    Senior Data Engineer - Python

    Globner Consulting LLPPune
    Responsibilities : - Design, develop, and maintain scalable data pipelines using Python and modern data engineering tools. Understanding of banking data models, finan...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Python

    Senior Data Engineer - Python

    People Prime World WidePune
    About Client : Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France.Founded in 1967, It h...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Cloud Data Engineer - PySpark / SQL

    Lead Cloud Data Engineer - PySpark / SQL

    upGradPune
    About the Job : We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark.Work with Databricks platform using Spark for big data processing and an...Show moreLast updated: 30+ days ago
    • Promoted
    Zywave - Senior Data Platform Engineer - SQL / Python

    Zywave - Senior Data Platform Engineer - SQL / Python

    ZywavePune
    Job Title : Senior Data Platform Engineer.Work Mode : Work From Office (WFO), 5 Days a Week.Shift Timing : 12 : 00 PM - 9 : 00 PM IST.About Zywave : Zywa...Show moreLast updated: 8 days ago