Talent.com
Azure Cloud Data Engineer

Azure Cloud Data Engineer

Intelebeemadurai, India
15 days ago
Job description

End-to-End Data Engineering

We’re looking for a hands-on Cloud Data Engineer who’s an expert in Python, PySpark, and SQL — with proven experience building end-to-end data pipelines on Azure using Data Factory, Synapse, and Databricks .

This role blends strong technical skills with sharp business understanding — ideal for someone who loves solving problems, designing scalable data solutions, and working closely with business teams.

Key Responsibilities :

End-to-End Data Engineering

  • Build and optimize data pipelines and ETL processes using ADF, Synapse, and Databricks .
  • Develop high-performance data transformations using Python, PySpark, and Advanced SQL .
  • Design and implement Lakehouse / Medallion architecture on Azure.
  • Create data models and Lakehouse to support analytics and BI initiatives.
  • Work directly with business stakeholders to gather requirements and translate them into scalable technical solutions.
  • Ensure data quality, governance, and performance optimization across large-scale datasets.

Customer Interaction & Technical Documentation

  • Interact with clients and business stakeholders to gather and analyze data requirements for building customized solutions.
  • Create clear and concise technical specification documents, detailing the architecture, data flow, and integration plans for project delivery.
  • CI / CD & Automation

  • Implement and manage CI / CD pipelines for data engineering projects, ensuring continuous integration and delivery of data processing and ETL jobs.
  • Automate data workflows and operationalize data processes, ensuring high performance and reliability.
  • Leadership & Mentorship

  • Lead and mentor junior data engineers, fostering a collaborative environment for learning and development.
  • Provide technical leadership and guidance throughout the project lifecycle, ensuring best practices are adhered to in all stages.
  • Required Skills & Experience :

  • Experience : 8-10 years in data engineering roles, with preferably at least 2 years in a lead role.
  • Azure Ecosystem : In-depth experience with Azure Data Factory, Azure Databricks, Azure SQL Data Warehouse, and Data Lake Storage.
  • Data Engineering Concepts : Strong understanding of end-to-end data engineering concepts, including ETL pipelines, data integration, and real-time data processing.
  • Dimensional Modeling & Data Warehousing : Solid experience with dimensional modeling and designing scalable data warehousing solutions.
  • Lakehouse Architecture & Medallion Architecture : Practical experience with implementing Lakehouse architecture and Medallion architecture patterns on Azure.
  • Security & Governance : Experience designing data governance frameworks, ensuring data security and compliance with industry standards.
  • CI / CD : Proficiency in setting up and maintaining CI / CD pipelines, automating deployment processes for data engineering.
  • On-prem & Cloud Databases : Experience with managing both on-premise and cloud-based large-scale databases, ensuring performance, security, and scalability.
  • Customer Interaction : Excellent communication skills with the ability to gather business requirements, create technical specs, and ensure stakeholder satisfaction.
  • Preferred Skills :

  • Certifications : Azure / AWS Data Engineer or similar certifications are a plus
  • Personal Attributes :

  • Problem-Solving : Strong analytical and troubleshooting skills.
  • Collaborative : Ability to work effectively with cross-functional teams and mentor junior engineers.
  • Detail-Oriented : Strong attention to detail with a practical approach to complex data engineering challenges.
  • Salary Range : Negotiable depending on experience and interview performance

    Time Preferred : Night shift till 5 : 00 am - IST (This is a must and no exception - adequate compensation will be offered for the Night shift)

    PTO : 18 days / year and 10 public holidays

    Important to have very good conversational skills in English

    Create a job alert for this search

    Data Engineer Azure • madurai, India

    Related jobs
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    ProgliteMadurai, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    LatentBridgedindigul, tamil nadu, in
    Job Title : Cloud Data Engineer (Kubernetes / Trino).Location : India(Pune / Bangalore / Bhopal / Remote).Technical evaluation – focused on. Azure infrastructure knowledge.Best practices in operations and ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroDindigul, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtreedindigul, tamil nadu, in
    Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsmadurai, tamil nadu, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr Azure Data Engineer - Remote work

    Sr Azure Data Engineer - Remote work

    techolutiondindigul, India
    Remote
    The ideal candidate will have a strong foundation in.Work Timings : 5 : 00 PM to 2 : 00 AM IST.If your expertise is primarily in. Lead the migration of large-scale SQL workloads from on-premise environme...Show moreLast updated: 22 hours ago
    • Promoted
    Cloud Consultant

    Cloud Consultant

    Mastekdindigul, tamil nadu, in
    We need an experienced AWS Data Engineer / Performance Optimization Consultant to help us analyze, tune, and optimize our existing AWS Glue ETL, Step Functions workflows and Amazon Redshift data wa...Show moreLast updated: 23 hours ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesmadurai, tamil nadu, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 9 days ago
    • Promoted
    Azure Cloud Architect

    Azure Cloud Architect

    Persistent Systemsdindigul, tamil nadu, in
    We are seeking an experienced Azure Data Cloud Architect to design, implement, and optimize cutting-edge data solutions on Microsoft Azure. You will collaborate with cross-functional teams to transl...Show moreLast updated: 22 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iomadurai, tamil nadu, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer – Azure & Aws

    Data Engineer – Azure & Aws

    Yoda TechDindigul, Republic Of India, IN
    We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 1 day ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    ACL Digitaldindigul, tamil nadu, in
    You’ll win us over if you have : .Deep expertise in AWS Cloud Services and IaC (CloudFormation).A solid understanding of CI / CD and DevOps principles. Manage and optimize AWS services including S3, Dyn...Show moreLast updated: 1 day ago
    • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    iVoyantdindigul, tamil nadu, in
    One of our clients is looking for an experienced Senior Snowflake Data Engineer to join their team.We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering a...Show moreLast updated: 1 day ago
    • Promoted
    Azure Technical Consultant- Cloud Engineer

    Azure Technical Consultant- Cloud Engineer

    Dogma Groupmadurai, tamil nadu, in
    Job Title : Azure Technical Consultant / Cloud Engineer.Location : Remote (Working Hours : BST) Normal IST hours as and when needed. Employment Type : Full-Time | Dedicated UK Client Engagement.We are s...Show moreLast updated: 23 hours ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    SysTechCorp Incdindigul, tamil nadu, in
    Experience in AWS cloud – Lambda based microservices.GitHub CICD experience (GitHub Actions is a plus).Go & Python programming language. Experience in building & managing CICD pipelines for Kubernet...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneDindigul, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer – Azure & AWS

    Data Engineer – Azure & AWS

    Yoda TechMadurai, IN
    We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 10 days ago
    • Promoted
    Azure Snowflake Data Engineer

    Azure Snowflake Data Engineer

    LTIMindtreedindigul, tamil nadu, in
    Design, develop, and maintain scalable data pipelines using.Collaborate with cross-functional teams to gather requirements and deliver data solutions. Ensure data quality, integrity, and security ac...Show moreLast updated: 1 day ago