Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Mastekchennai, tamil nadu, in
17 hours ago
Job description

Job Title : Databricks SQL Engineer (with Pharma / Life Sciences background)

About the Role :

We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible for building scalable and efficient data models, queries, and pipelines that power analytical insights and business decisions.

Key Responsibilities :

  • Design, develop, and optimize SQL-based data models and queries in Databricks for large-scale datasets.
  • Work with Delta Lake, Unity Catalog, and Databricks Notebooks to manage and secure data assets.
  • Implement and maintain ETL / ELT pipelines using Databricks workflows and SQL.
  • Develop documentation and data dictionaries to promote self-service analytics.
  • Ensure data quality and consistency through testing, validation, and monitoring.
  • Optimize data lakehouse architecture for cost and performance, leveraging Spark SQL best practices.
  • Support CI / CD practices for deploying notebooks and SQL jobs to production.

Required Qualifications :

  • 5+ years of experience working with Databricks SQL, Pyspark, Spark SQL, or similar distributed SQL engines.
  • Experience in the Pharma Domain
  • Strong experience with Delta Lake, structured streaming, and data lakehouse paradigms.
  • Proficiency in SQL development, query tuning, and working with large datasets.
  • Experience with version control tools (Git) and collaborative development practices.
  • Experience working in cloud environments (AWS, Azure, or GCP), preferably with Azure Databricks or Databricks on AWS.
  • Understanding of data governance, access control, and tools like Unity Catalog or Purview.
  • Familiarity with CI / CD for data pipelines and automation tools like Databricks Repos, Terraform, or dbx.
  • Exposure to Python or PySpark for scripting and data manipulation.
  • Create a job alert for this search

    Data Engineer • chennai, tamil nadu, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    TCS is hiring for GCP data engineer, please find the below JD.Experience range – 6 to 8 years.Location - Bengaluru / Chennai / Gurgaon. Skills Required - GCP BigQuery, Python.Hands-on experience in the ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CYGNVSChennai, India
    We’re looking for Data Engineers on our Analytics Engineering team - you’ll collaborate with teams across the globe to build pipelines and systems to deliver data insights critical to our customers...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyChennai, Tamil Nadu, India
    Designation : Senior Data Engineer Location : India(Remote) Roles and Responsibilities : As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environme...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC ServicesSaint Thomas Mount, Tamil Nadu, India
    Key Responsibilities Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and str...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, Tamil Nadu, India
    Job Responsibilities - Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsChennai, Tamil Nadu, India
    Role : Data Engineering Remote Looking for 5-10 years of Exp • Design, develop & maintain ETL / ELT pipelines • Ingest & transform data from APIs, DBs, files, streams • Build real-time & batch process...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tekshiras Software Services Private LimitedSaint Thomas Mount, Tamil Nadu, India
    We’re Hiring – Senior Data Engineer (10+ Years Experience) Location : Hyderabad (Hybrid) We are looking for a seasoned professional with strong expertise in Data Engineering, Data Analysis, SQL an...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreeChennai, Tamil Nadu, India
    We are hiring for AWS Data Engineer.Notice period - immediate to 30 days.Seeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and impl...Show moreLast updated: 30+ days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    DNA Technology ServicesChennai, IN
    We are looking for an experienced.The ideal candidate will have strong expertise in Snowflake, cloud platforms (AWS / Azure), and modern data engineering practices, with the ability to design and imp...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Xebiachennai, tamil nadu, in
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Everisechennai, tamil nadu, in
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data SolutionsChennai, Tamil Nadu, India
    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queu...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Beatly.AIAmbattur, Tamil Nadu, India
    We develop cutting-edge technologies that enhance decision-making and efficiency across critical domains.If you're passionate about creating meaningful AI products and thrive in a collaborative, in...Show moreLast updated: 19 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeChennai, Tamil Nadu, India
    Onsite / Hybrid (as applicable).We are looking for a highly skilled and motivated.The ideal candidate will have strong expertise in. DBT, Snowflake, CI / CD pipelines.This role requires individuals wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Cleantech Industry ResourcesChennai, Tamil Nadu, India
    Cleantech Industry Resources accelerates United States solar, battery storage and EV projects by providing turnkey development as a service including 100% internal systems engineering.The company d...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivechennai, tamil nadu, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsChennai, Tamil Nadu, India
    Job Description : Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines. Exposure to Databricks data ingestion jobs along with incident managemen...Show moreLast updated: 23 days ago
    • Promoted
    Innefu - Data Analyst / Business Analyst

    Innefu - Data Analyst / Business Analyst

    Innefu Labs Pvt. Ltd.Tambaram,Tamil Nadu, India
    Department : Data Analytics.About Innefu Labs Pvt Ltd : Innefu Labs is a leading cybersecurity and data analytics company, providing innova...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Skills : ADB, ADF, ETL developer.Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago