Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Masteksangli, maharashtra, in
1 day ago
Job description

Job Title : Databricks SQL Engineer (with Pharma / Life Sciences background)

About the Role :

We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible for building scalable and efficient data models, queries, and pipelines that power analytical insights and business decisions.

Key Responsibilities :

  • Design, develop, and optimize SQL-based data models and queries in Databricks for large-scale datasets.
  • Work with Delta Lake, Unity Catalog, and Databricks Notebooks to manage and secure data assets.
  • Implement and maintain ETL / ELT pipelines using Databricks workflows and SQL.
  • Develop documentation and data dictionaries to promote self-service analytics.
  • Ensure data quality and consistency through testing, validation, and monitoring.
  • Optimize data lakehouse architecture for cost and performance, leveraging Spark SQL best practices.
  • Support CI / CD practices for deploying notebooks and SQL jobs to production.

Required Qualifications :

  • 5+ years of experience working with Databricks SQL, Pyspark, Spark SQL, or similar distributed SQL engines.
  • Experience in the Pharma Domain
  • Strong experience with Delta Lake, structured streaming, and data lakehouse paradigms.
  • Proficiency in SQL development, query tuning, and working with large datasets.
  • Experience with version control tools (Git) and collaborative development practices.
  • Experience working in cloud environments (AWS, Azure, or GCP), preferably with Azure Databricks or Databricks on AWS.
  • Understanding of data governance, access control, and tools like Unity Catalog or Purview.
  • Familiarity with CI / CD for data pipelines and automation tools like Databricks Repos, Terraform, or dbx.
  • Exposure to Python or PySpark for scripting and data manipulation.
  • Create a job alert for this search

    Data Engineer • sangli, maharashtra, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    SapaadKolhapur, IN
    Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries. Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IGT SolutionsKolhapur, IN
    Interested candidate please share resume on Kalyani.Design, develop, and maintain scalable data pipelines using Python and PySpark. Work with SQL and MongoDB to manage and query large datasets.Devel...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsKolhapur, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainKolhapur, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Forage AIKolhapur, IN
    Experience Level : Data Engineer- 3- 7 years of relevant experience in data engineering.Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructu...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncKolhapur, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaKolhapur, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 21 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ATOM Systems Private LimitedKolhapur, IN
    We are seeking a highly skilled and driven Data Engineering Lead to lead our data engineering team.The ideal candidate combines strong leadership and technical expertise with the ability to deliver...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyKolhapur, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeKolhapur, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseKolhapur, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesKolhapur, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsKolhapur, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisKolhapur, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 1 day ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    EXLKolhapur, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    The Transformation GroupKolhapur, IN
    The ideal candidate should possess experience with ETL, data and reporting; and contributing code to deliver new features and functionality. Day-to-day you will collaborate with engineers, product m...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Jade Business Services (JBS)Kolhapur, IN
    Data Engineer (AI Knowledge Base Platform).The engineer will be responsible for ensuring reliable, scalable, and secure data movement across multiple sources, powering Retrieval-Augmented Generatio...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXKolhapur, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsKolhapur, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalKolhapur, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 1 day ago