Talent.com
This job offer is not available in your country.
Azure Data Engineer - Python / ETL

Azure Data Engineer - Python / ETL

WorksconsultancyBangalore,Chennai,Hyderabad,Pune
30+ days ago
Job description

We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks. The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies.

Key Responsibilities :

  • Collaborate with business and IT stakeholders to define business and functional requirements for data solutions.
  • Design and implement scalable ETL / ELT pipelines using Azure Data Factory, Databricks, and Snowflake.
  • Develop detailed technical designs, data flow diagrams, and future-state data architecture.
  • Evangelize modern data modelling practices, including entity-relationship models, star schema, and Kimball methodology.
  • Ensure data governance, quality, and validation by working closely with quality engineering teams.
  • Write, optimize, and troubleshoot complex SQL queries, including DDL, DML, and performance tuning.
  • Work with Azure Synapse, Azure Data Lake, and Snowflake for large-scale data processing.
  • Implement DevOps and CI / CD best practices for automated data pipeline deployments.
  • Support real-time streaming data processing with Spark, Kafka, or similar technologies.
  • Provide technical mentorship and guide team members on best practices in SQL, ETL, and cloud data solutions.
  • Stay up to date with emerging cloud and data engineering technologies and demonstrate a continuous learning mindset.

Required Skills & Qualifications :

Primary Requirements :

  • SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning.
  • Programming Languages Proficiency in Python or Java for data processing and automation.
  • Data Modelling Good understanding of entity-relationship modelling, star schema, and Kimball methodology.
  • Cloud Data Engineering Hands-on experience with Azure Synapse, Azure Data Factory, Azure Data Lake, Databricks and Snowflake
  • ETL Development Experience building scalable ETL / ELT pipelines and data ingestion workflows.
  • Ability to learn and apply Snowflake concepts as needed.
  • Communication Skills : Strong presentation and communication skills to engage both technical and business stakeholders in strategic discussions.
  • Financial Services Domain (Optional) : Knowledge of financial services.
  • Good to Have Skills :

  • DevOps & CI / CD Experience with Git, Jenkins, Docker, and automated deployments.
  • Streaming Data Processing Experience with Spark, Kafka, or real-time event-driven architectures.
  • Data Governance & Security Understanding of data security, compliance, and governance frameworks.
  • Experience in AWS Knowledge of AWS cloud data solutions (Glue, Redshift, Athena, etc.) is a plus.
  • Primary Requirements :

  • SQL Expertise : Strong hands-on experience with DDL, DML, query optimization, and performance tuning.
  • Programming Languages : Proficiency in Python or Java for data processing and automation.
  • Data Modelling : Good understanding of entity-relationship modelling, star schema, and Kimball methodology.
  • Cloud Data Engineering : Hands-on experience with Azure Synapse, Azure Data Factory, Azure Data Lake, Databricks and Snowflake
  • ETL Development : Experience building scalable ETL / ELT pipelines and data ingestion workflows.
  • Ability to learn and apply Snowflake concepts as needed.
  • Communication Skills : Strong presentation and communication skills to engage both technical and business stakeholders in strategic discussions
  • Notice period : 30days

    (ref : hirist.tech)

    Create a job alert for this search

    Azure Data Engineer • Bangalore,Chennai,Hyderabad,Pune

    Related jobs
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesChennai, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.chennai, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data SolutionsChennai, India
    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queu...Show moreLast updated: 6 days ago
    • Promoted
    Eucloid - Senior / Lead Data Engineer - Python

    Eucloid - Senior / Lead Data Engineer - Python

    Eucloid Data Solutions Pvt LtdChennai
    Job Description : Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will suppor...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer - Python / ETL / Scala

    Lead Data Engineer - Python / ETL / Scala

    Cynosure Corporate SolutionsChennai
    About the Role : We are seeking a highly skilled and experienced Senior / Lead Data Engineer to design, develop, and maintain scalable, reliable, and efficient data ...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesChennai, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Azure Data Engineer - Python / PySpark

    Azure Data Engineer - Python / PySpark

    GALAXY I TECHNOLOGIES INCChennai
    Role Description : We are seeking a highly skilled Azure Data Engineer to join our team.The ideal candidate will be responsible for designing, building, and maintaini...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Azure Platform

    Senior Data Engineer - Azure Platform

    Resource Tree Global ServicesChennai
    Job Name : Senior Data Engineer Azure Years of Experience : 5 Job Description : We are look...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Ashley Global Capability CenterChennai, Tamil Nadu, India
    Bachelor's or master’s degree in Computer Science, Mathematics, or related field.Years of experience in developing technology solutions, integrating, or creating AI and machine learning models.Know...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iochennai, tamil nadu, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    ImpetusChennai, Tamil Nadu, India
    Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;.Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity. Collaborates with analytics and business...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceschennai, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 29 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Skills : ADB, ADF, ETL developer.Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer(Chennai, Indore,Pune)

    AWS Data Engineer(Chennai, Indore,Pune)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Good knowledge and experience in Pyspark for forming complex Transformation logic.Secondary : AWS Glue , Airflow.A minimum of 3 + years' experience and understanding of Python core concepts, and im...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    TVS NextChennai, Tamil Nadu, India
    You will be responsible for the development, integration and deployment of software products.Being part of a distributed agile team, you will be expected to code, conduct code reviews, and test sof...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesChennai, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekchennai, tamil nadu, in
    We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 17 days ago