Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Mastekhyderabad, telangana, in
2 days ago
Job description

Job Title : Databricks SQL Engineer (with Pharma / Life Sciences background)

About the Role :

We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible for building scalable and efficient data models, queries, and pipelines that power analytical insights and business decisions.

Key Responsibilities :

  • Design, develop, and optimize SQL-based data models and queries in Databricks for large-scale datasets.
  • Work with Delta Lake, Unity Catalog, and Databricks Notebooks to manage and secure data assets.
  • Implement and maintain ETL / ELT pipelines using Databricks workflows and SQL.
  • Develop documentation and data dictionaries to promote self-service analytics.
  • Ensure data quality and consistency through testing, validation, and monitoring.
  • Optimize data lakehouse architecture for cost and performance, leveraging Spark SQL best practices.
  • Support CI / CD practices for deploying notebooks and SQL jobs to production.

Required Qualifications :

  • 5+ years of experience working with Databricks SQL, Pyspark, Spark SQL, or similar distributed SQL engines.
  • Experience in the Pharma Domain
  • Strong experience with Delta Lake, structured streaming, and data lakehouse paradigms.
  • Proficiency in SQL development, query tuning, and working with large datasets.
  • Experience with version control tools (Git) and collaborative development practices.
  • Experience working in cloud environments (AWS, Azure, or GCP), preferably with Azure Databricks or Databricks on AWS.
  • Understanding of data governance, access control, and tools like Unity Catalog or Purview.
  • Familiarity with CI / CD for data pipelines and automation tools like Databricks Repos, Terraform, or dbx.
  • Exposure to Python or PySpark for scripting and data manipulation.
  • Create a job alert for this search

    Data Engineer • hyderabad, telangana, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLHyderabad, Telangana, India
    The role involves building and optimizing ETL / ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI / ML, and business intelligence use cases.AWS (S...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseHyderabad, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXHyderabad, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    OptumHyderabad, Telangana, India
    Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions. Utilize knowledge of variou...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Talogysecunderabad, telangana, in
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    SoftobizHyderabad, Telangana, India
    Career-defining role available with Tier 1 Blue Chip Australian Client.As a Data Engineer, you will be involved in all phases of the software development life cycle, collecting and documenting busi...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softhyderabad, telangana, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    SapaadHyderabad, IN
    Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries. Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Magma ConsultancyHyderabad, IN
    Part-time (20–25 hours per week).The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers,...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Tanla Platforms LimitedHyderabad, Telangana, India
    We are seeking a skilled Data Engineer with 5–10 years of experience to join our dynamic Data.The ideal candidate will design, build, and optimize large-scale data pipelines and warehouses that ena...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika IncHyderabad, Telangana, India
    Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge technologies in...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesHyderabad, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    The Transformation GroupSecunderabad, Telangana, India
    The ideal candidate should possess experience with ETL, data and reporting; and contributing code to deliver new features and functionality. Day-to-day you will collaborate with engineers, product m...Show moreLast updated: 12 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    StraiveHyderabad, IN
    Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs.The ideal candidate will ...Show moreLast updated: 14 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsHyderabad, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ConfidentialBengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, Chennai
    Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python and PySpark to ensure the efficient and reliable delivery of data.Design and implement cu...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsHyderabad, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 24 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    NAF Technology IndiaHyderabad, IN
    Do you love a Challenge? Are you Passionate about technology? Are you customer obsessed? Looking to innovate? Join NAF Tech! New American Funding (NAF) is a mortgage lender offering an array of loa...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC ServicesHyderabad, India
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 30+ days ago