Talent.com
No longer accepting applications
Senior Azure Data Engineer

Senior Azure Data Engineer

Tata Consultancy Servicespune, maharashtra, in
2 days ago
Job description

Greetings from TCS!

Job Title : Senior Azure Data Engineer

Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL.

Location : Gurugram

Experience Range : 6-8 years

Job Description

Must-Have

  • Good Knowledge of Data Brick lakehouse and Azure DataLake concept
  • Knowledge of Data Bricks delta concept
  • Delta live tables (DLT)
  • Strong hands-on experience in ELT– pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
  • Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic
  • In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool.
  • Experience with data transformation using Spark, and SQL technologies.
  • Solid understanding of design patterns, and best practices of the cloud stack.
  • Experience with code management and version control using Git or similar tools.
  • Strong problem-solving and debugging skills in ETL workflows and data pipelines.
  • Strong understanding of Azure Data bricks and Azure Synapse internals – features and capabilities.
  • Knowledge of Azure DevOps and continuous integration and deployment (CI / CD) process.
  • Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing

Good To Have :

  • Power Shell Knowledge
  • Power BI Knowledge
  • Responsibility of / Expectations from the Role :

  • Conducting technical sessions, design reviews, code reviews, and demos of pipelines and their functionality
  • Developing technical specification for Data pipelines and workflow and getting sign-off from Architect and Stryker leads.
  • Developing, deploying, and maintaining workflows and data pipelines using Azure Data bricks and Azure Synapse.
  • Developing pipeline / notebook for Delta live tables ( DLT) Databricks Auto Loader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
  • Writing efficient and high-performing ETL code using PySpark, and SQL technologies.
  • Thanks & Regards,

    Ria Aarthi A.

    Create a job alert for this search

    Azure Data Engineer • pune, maharashtra, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLPune, Maharashtra, India
    Key Responsibilities : • Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovat...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Lead Engineer

    Azure Data Lead Engineer

    Persistent SystemsPune, Maharashtra, India
    About Position : We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Role : Azure Data Lead Engineer - Location : Pune / Ba...Show moreLast updated: 4 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Capgemini InventPune, Maharashtra, India
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show moreLast updated: 3 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesPune, Maharashtra, India
    Greetings from Tata Consultancy Services!! We are hiring for Data Engineer Required Skillset : Python, Pyspark, Azure Function Python, Pyspark, Data bricks Python, Pyspark, Azure Function, Data Bri...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tech MahindraPune, IN
    Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Senior Data Engineer - Azure Platform

    Senior Data Engineer - Azure Platform

    Futran SolutionsPune
    Description : Job Description : We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure ...Show moreLast updated: 16 hours ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Pune, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersPune, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 4 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    InfarsightPune, Maharashtra, India
    Infarsight helps enterprises scale strategic business transformation through automation,.We streamline operations with platforms like Task Sight, Trip. Sight, and Fleet Sight, turning complexity int...Show moreLast updated: 11 days ago
    • Promoted
    Sr.Azure Data Engineer

    Sr.Azure Data Engineer

    Persistent SystemsPune, Maharashtra, India
    About Position : We are looking for Sr Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Azure Data Engineer - Location : Pune / Bangalore - Expe...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent SystemsPune, Maharashtra, India
    A highly skilled Data Engineering professional with 6 to 8 years of experience in designing, developing, and maintaining robust data solutions. Proven ability to work across the full software develo...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    SystemBenderPune, IN
    Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 12 days ago
    • Promoted
    Senior Azure Data Engineer - Full remote - contractor in USD

    Senior Azure Data Engineer - Full remote - contractor in USD

    All European CareersPune, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear CorporationPune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerxPune, Maharashtra, India
    About the Role : We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions.The ideal candidate wi...Show moreLast updated: 30+ days ago
    • Promoted
    6221 Azure Data Engineer

    6221 Azure Data Engineer

    EXLPune, Maharashtra, India
    Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SPIROPune, Maharashtra, India
    Position : Senior Data Engineer Location : Pune Experience : 5+ years Job Summary : We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data techn...Show moreLast updated: 30+ days ago