Talent.com
This job offer is not available in your country.
Data Engineer – Airflow | Python | Databricks

Data Engineer – Airflow | Python | Databricks

InternationalClientsChennai, Tamil Nadu, India
6 hours ago
Job description

Location : Chennai, India (Onsite initially, Remote flexibility later)

Work Days : Monday to Friday

Experience : 4-7 years

Client : Leading Life Sciences Company – Specialized in the Pharmaceutical Industry

Job Description :

We are seeking a skilled Data Engineer with expertise in Apache Airflow , Python , and cloud-based data platforms to support our client, a global leader in the pharmaceutical and life sciences industry . This role will be based onsite in Chennai initially, with the potential to transition to remote work based on project needs.

You will be responsible for building and managing reliable data pipelines and supporting data infrastructure critical to analytics and decision-making processes in a highly regulated environment.

Key Responsibilities :

  • Develop and manage data pipelines and ETL workflows using Apache Airflow .
  • Write clean, efficient code using Python for data ingestion, transformation, and automation.
  • Work with Databricks , DBT , and PySpark to implement scalable data processing.
  • Collaborate to understand data requirements and deliver solutions.
  • Monitor and troubleshoot data workflows to ensure reliability and performance.
  • Document processes and follow version control best practices.

Required Skills :

  • 4–7 years of experience as a Data Engineer or in a related data-focused role.
  • Strong proficiency in Apache Airflow , Python , and SQL .
  • Hands-on experience with Databricks , DBT , and PySpark .
  • Experience working with cloud platforms such as Azure , AWS , or GCP .
  • Understanding of data modeling, data lake / lakehouse concepts, and performance tuning.
  • Strong communication and problem-solving skills.
  • Create a job alert for this search

    Data Engineer Python • Chennai, Tamil Nadu, India

    Related jobs
    • Promoted
    • New!
    Python Data Engineer

    Python Data Engineer

    Response InformaticsChennai, Tamil Nadu, India
    Response Informatics is looking for.Python Full Stack Developer – Chennai(WFO).Skills -Python,ReactJS,RESTful APIs,PostgreSQL or MySQL,Agile / Scrum,FastAPI, Flask, or Django,JSON,TypeScript and fami...Show moreLast updated: 6 hours ago
    • Promoted
    AWS Data Engineer - Redshift, Pyspark, Glue

    AWS Data Engineer - Redshift, Pyspark, Glue

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill - AWS Data Engineer - Redshift, Pyspark, Glue Exp range - 5 yrs - 8yrs Location- Chennai Notice period 30 day...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesChennai, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 17 days ago
    • Promoted
    Azure Data Engineer - Python / PySpark

    Azure Data Engineer - Python / PySpark

    GALAXY I TECHNOLOGIES INCChennai
    Role Description : We are seeking a highly skilled Azure Data Engineer to join our team.The ideal candidate will be responsible for designing, building, and maintaini...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreeChennai, Tamil Nadu, India
    We are hiring for AWS Data Engineer.Notice period - immediate to 30 days.Seeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and impl...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Chennai, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Ashley Global Capability CenterChennai, Tamil Nadu, India
    Bachelor's or master’s degree in Computer Science, Mathematics, or related field.Years of experience in developing technology solutions, integrating, or creating AI and machine learning models.Know...Show moreLast updated: 30+ days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsChennai, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 6 days ago
    • Promoted
    Azure Data Engineer - Python / ETL

    Azure Data Engineer - Python / ETL

    WorksconsultancyBangalore,Chennai,Hyderabad,Pune
    We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks. The ideal candidate should have a solid understanding of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionChennai, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyChennai, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ImpetusChennai, Tamil Nadu, India
    Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;.Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity. Collaborates with analytics and business...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceschennai, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 6 days ago
    • Promoted
    Appglide - Senior Python Data Engineer

    Appglide - Senior Python Data Engineer

    Appglide.ioChennai
    We are seeking a Senior Python Data Engineer to join our customers Solutions Engineering Team.This role is ideal for an experienced professional who thrives in a fast-paced, customer-facing environ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer(Chennai, Indore,Pune)

    AWS Data Engineer(Chennai, Indore,Pune)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Good knowledge and experience in Pyspark for forming complex Transformation logic.Secondary : AWS Glue , Airflow.A minimum of 3 + years' experience and understanding of Python core concepts, and im...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesChennai, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data engineer ( Only Chennai / Hyderabad and kolkata Location)- 6-8 Years

    AWS Data engineer ( Only Chennai / Hyderabad and kolkata Location)- 6-8 Years

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Greetings from TATA Consultancy Services.Pls find the Job Description below.Hands-on experience in Pyspark, Glue.Experience on EMR, S3, IAM, Lambda, Cloud formation, Python.AMI Rehydration, Python,...Show moreLast updated: 2 days ago