Talent.com
Data Engineer

Data Engineer

Mastekjamnagar, gujarat, in
9 days ago
Job description

Job Title : Databricks SQL Engineer (with Pharma / Life Sciences background)

About the Role :

We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible for building scalable and efficient data models, queries, and pipelines that power analytical insights and business decisions.

Key Responsibilities :

  • Design, develop, and optimize SQL-based data models and queries in Databricks for large-scale datasets.
  • Work with Delta Lake, Unity Catalog, and Databricks Notebooks to manage and secure data assets.
  • Implement and maintain ETL / ELT pipelines using Databricks workflows and SQL.
  • Develop documentation and data dictionaries to promote self-service analytics.
  • Ensure data quality and consistency through testing, validation, and monitoring.
  • Optimize data lakehouse architecture for cost and performance, leveraging Spark SQL best practices.
  • Support CI / CD practices for deploying notebooks and SQL jobs to production.

Required Qualifications :

  • 5+ years of experience working with Databricks SQL, Pyspark, Spark SQL, or similar distributed SQL engines.
  • Experience in the Pharma Domain
  • Strong experience with Delta Lake, structured streaming, and data lakehouse paradigms.
  • Proficiency in SQL development, query tuning, and working with large datasets.
  • Experience with version control tools (Git) and collaborative development practices.
  • Experience working in cloud environments (AWS, Azure, or GCP), preferably with Azure Databricks or Databricks on AWS.
  • Understanding of data governance, access control, and tools like Unity Catalog or Purview.
  • Familiarity with CI / CD for data pipelines and automation tools like Databricks Repos, Terraform, or dbx.
  • Exposure to Python or PySpark for scripting and data manipulation.
  • Create a job alert for this search

    Data Engineer • jamnagar, gujarat, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    RevXJamnagar, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + CompanyJamnagar, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softjamnagar, gujarat, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 9 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDjamnagar, gujarat, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 19 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncJamnagar, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    GEMRAJ TECHNOLOGIES LIMITEDJamnagar, IN
    We are currently seeking a Data Engineer to join our technology team.In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure.The ideal candidate i...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeJamnagar, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    EXLJamnagar, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladejamnagar, gujarat, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 19 days ago
    • Promoted
    • New!
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsJamnagar, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 13 hours ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradJamnagar, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Impetusjamnagar, gujarat, in
    Strong ability to write clean and efficient code.Good understanding of Spark SQL for distributed data processing.Experience with large datasets and structured data manipulation.Ability to write que...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyJamnagar, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalJamnagar, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHjamnagar, gujarat, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Databricks Expert

    Data Engineer - Databricks Expert

    Nebula Tech Solutionsjamnagar, gujarat, in
    Data Engineer – Databricks Expert.Are you passionate about building scalable data pipelines and optimizing performance with cutting-edge tools like Databricks and Apache Spark? We're looking for a....Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseJamnagar, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Jaipur RugsJamnagar, IN
    Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 5 days ago