Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Mastekdombivli, maharashtra, in
4 days ago
Job description

Job Title : Databricks SQL Engineer (with Pharma / Life Sciences background)

About the Role :

We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible for building scalable and efficient data models, queries, and pipelines that power analytical insights and business decisions.

Key Responsibilities :

  • Design, develop, and optimize SQL-based data models and queries in Databricks for large-scale datasets.
  • Work with Delta Lake, Unity Catalog, and Databricks Notebooks to manage and secure data assets.
  • Implement and maintain ETL / ELT pipelines using Databricks workflows and SQL.
  • Develop documentation and data dictionaries to promote self-service analytics.
  • Ensure data quality and consistency through testing, validation, and monitoring.
  • Optimize data lakehouse architecture for cost and performance, leveraging Spark SQL best practices.
  • Support CI / CD practices for deploying notebooks and SQL jobs to production.

Required Qualifications :

  • 5+ years of experience working with Databricks SQL, Pyspark, Spark SQL, or similar distributed SQL engines.
  • Experience in the Pharma Domain
  • Strong experience with Delta Lake, structured streaming, and data lakehouse paradigms.
  • Proficiency in SQL development, query tuning, and working with large datasets.
  • Experience with version control tools (Git) and collaborative development practices.
  • Experience working in cloud environments (AWS, Azure, or GCP), preferably with Azure Databricks or Databricks on AWS.
  • Understanding of data governance, access control, and tools like Unity Catalog or Purview.
  • Familiarity with CI / CD for data pipelines and automation tools like Databricks Repos, Terraform, or dbx.
  • Exposure to Python or PySpark for scripting and data manipulation.
  • Create a job alert for this search

    Data Engineer • dombivli, maharashtra, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Magma Consultancydombivli, maharashtra, in
    Part-time (20–25 hours per week).The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers,...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHdombivli, maharashtra, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgedombivli, maharashtra, in
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisThane, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softmumbai city, maharashtra, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyKalyan-Dombivli, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalThane, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 4 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDdombivli, maharashtra, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    OWOWMumbai, IN
    Data Architecture & Infrastructure (40%) .Design and implement a multi-database architecture (MongoDB, Redis, Milvus, Neo4j, BigQuery) . Build scalable data pipelines for real-time conversation proc...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    SolarSquareMumbai, Maharashtra, India
    Job Description : Data Engineer.As a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure.Your work will transform raw, messy data into clean,. You’ll collaborate cross-fun...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaKalyan-Dombivli, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 25 days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Impactron Globaldombivli, maharashtra, in
    We’re seeking a Snowflake Data Engineer / Sr Data Engineer passionate about building scalable, cloud-native data solutions using Snowflake, dbt, and modern ETL frameworks.You will design, implement...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EnvuThane, Maharashtra, India
    At Envu, we partner with our customers to design world-class, forward-thinking innovations that protect and enhance the health of environments around the world. We offer dedicated services in : Profe...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekmumbai, maharashtra, in
    We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Velodata Global Pvt Ltddombivli, maharashtra, in
    Job Title : Data Engineer (Contract – 6 Months) and (Permanent positions are open ).Joining Date : October 22 (Candidate should work in our client office in Trivandrum from Oct 22 to October 31) aft...Show moreLast updated: 15 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseThane, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesKalyan-Dombivli, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    StraiveMumbai, Maharashtra, India
    Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs.The ideal candidate will ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicesnavi mumbai, maharashtra, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 24 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncThane, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 14 days ago