Talent.com
This job offer is not available in your country.
Data Engineer - Python

Data Engineer - Python

D Square Consulting Services Pvt LtdChennai
30+ days ago
Job description

JD - Data Engineer

This is a full-time position with D Square Consulting Services Pvt Ltd.

Location : Pan-india ( Hybrid).

Experience : 5+ years.

Notice Period : Candidates available to join immediately.

Job Summary :

We are seeking a skilled and experienced Data Engineer with strong Python expertise, API development experience, and a deep understanding of containerized, CI / CD-driven workflows.

You will play a key role in designing, building, and scaling data pipelines and backend services that support our analytics and business intelligence platforms.

This is a hands-on engineering role that requires a strong technical foundation and a collaborative mindset.

Key Responsibilities :

  • Design, implement, and optimize robust, scalable data pipelines and ETL workflows using modern Python tools and libraries.
  • Build and maintain production-grade RESTful and / or GraphQL APIs to serve data to internal and external stakeholders.
  • Collaborate with Data Analysts, Scientists, and Engineering teams to enable end-to-end data solutions.
  • Containerize data services using Docker and manage deployments within Kubernetes environments.
  • Develop and maintain CI / CD pipelines using GitHub Actions to automate testing, data validations, and deployment processes.
  • Ensure code quality through rigorous unit testing, type annotations, and adherence to Python best practices.
  • Participate in architecture reviews, design discussions, and code reviews in an agile development process.
  • Proactively identify opportunities to optimize data access, transformation, and governance.

Required Skills & Qualifications :

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.
  • 5+ years of hands-on experience in data engineering or backend development roles.
  • Expert-level Python skills, with a strong understanding of idiomatic patterns, async programming, and typing.
  • Proven experience in building production-grade RESTful or GraphQL APIs using frameworks like FastAPI, Graphene, or Strawberry.
  • Hands-on experience with Docker, container-based workflows, and CI / CD automation using GitHub Actions.
  • Experience working with Kubernetes for orchestrating deployments in production environments.
  • Proficient with SQL and data modeling; familiarity with ETL tools, data lakes, or warehousing concepts is a plus.
  • Strong communicator with a proactive and self-driven approach to problem-solving and Skills :
  • Familiarity with data orchestration tools (e.g, Airflow, Prefect).
  • Experience with streaming data platforms like Kafka or Spark.
  • Knowledge of data governance, security, and observability best practices.
  • Exposure to cloud platforms like AWS, GCP, or Azure.
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer Python • Chennai

    Related jobs
    • Promoted
    Eucloid - Senior / Lead Data Engineer - Python

    Eucloid - Senior / Lead Data Engineer - Python

    Eucloid Data Solutions Pvt LtdChennai
    Job Description : Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will suppor...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / PySpark

    Data Engineer - Python / PySpark

    MEEDEN LABS PRIVATE LIMITEDChennai
    Job Summary : We are seeking a skilled Data Engineer with strong expertise in Python and PySpark to design, develop, and optimize large-scale data ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data SolutionsChennai, India
    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queu...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesChennai, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Azure Data Engineer - Python / PySpark

    Azure Data Engineer - Python / PySpark

    GALAXY I TECHNOLOGIES INCChennai
    Role Description : We are seeking a highly skilled Azure Data Engineer to join our team.The ideal candidate will be responsible for designing, building, and maintaini...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Ashley Global Capability CenterChennai, Tamil Nadu, India
    Bachelor's or master’s degree in Computer Science, Mathematics, or related field.Years of experience in developing technology solutions, integrating, or creating AI and machine learning models.Know...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Chennai, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, India
    Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsChennai, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer - Python / Spark

    Data Engineer - Python / Spark

    O2F Info Solutions Pvt. Ltd.Chennai
    Job Summary : We are seeking a highly skilled Senior Data Engineer with 4 to 8 years of experience in building robust data pipelines and working extensively with PySp...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionChennai, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyChennai, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ImpetusChennai, Tamil Nadu, India
    Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;.Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity. Collaborates with analytics and business...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceschennai, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 5 days ago
    • Promoted
    Appglide - Senior Python Data Engineer

    Appglide - Senior Python Data Engineer

    Appglide.ioChennai
    We are seeking a Senior Python Data Engineer to join our customers Solutions Engineering Team.This role is ideal for an experienced professional who thrives in a fast-paced, customer-facing environ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 29 days ago
    • Promoted
    AWS Data Engineer(Chennai, Indore,Pune)

    AWS Data Engineer(Chennai, Indore,Pune)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Good knowledge and experience in Pyspark for forming complex Transformation logic.Secondary : AWS Glue , Airflow.A minimum of 3 + years' experience and understanding of Python core concepts, and im...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesChennai, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekchennai, tamil nadu, in
    We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer - Python / PySpark

    Senior Data Engineer - Python / PySpark

    Digivance SolutionChennai
    Job Title : Senior Data Engineer Location : Chennai (Hybrid 4 days from office per week) Experience ...Show moreLast updated: 21 days ago