Talent.com
Senior Azure Data Engineer

Senior Azure Data Engineer

Tata Consultancy ServicesGreater Bengaluru Area, India
30+ days ago
Job description

Greetings from TCS!

Job Title : Senior Azure Data Engineer

Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL.

Location : Gurugram

Experience Range : 6-8 years

Job Description

Must-Have

  • Good Knowledge of Data Brick lakehouse and Azure DataLake concept
  • Knowledge of Data Bricks delta concept
  • Delta live tables (DLT)
  • Strong hands-on experience in ELT– pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
  • Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic
  • In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool.
  • Experience with data transformation using Spark, and SQL technologies.
  • Solid understanding of design patterns, and best practices of the cloud stack.
  • Experience with code management and version control using Git or similar tools.
  • Strong problem-solving and debugging skills in ETL workflows and data pipelines.
  • Strong understanding of Azure Data bricks and Azure Synapse internals – features and capabilities.
  • Knowledge of Azure DevOps and continuous integration and deployment (CI / CD) process.
  • Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing

Good To Have :

  • Power Shell Knowledge
  • Power BI Knowledge
  • Responsibility of / Expectations from the Role :

  • Conducting technical sessions, design reviews, code reviews, and demos of pipelines and their functionality
  • Developing technical specification for Data pipelines and workflow and getting sign-off from Architect and Stryker leads.
  • Developing, deploying, and maintaining workflows and data pipelines using Azure Data bricks and Azure Synapse.
  • Developing pipeline / notebook for Delta live tables ( DLT) Databricks Auto Loader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
  • Writing efficient and high-performing ETL code using PySpark, and SQL technologies.
  • Thanks & Regards,

    Ria Aarthi A.

    Create a job alert for this search

    Azure Data Engineer • Greater Bengaluru Area, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    TEKsystems Global Services in IndiaBengaluru, Karnataka, India
    Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesGreater Bengaluru Area, India
    TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill : Azure D...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Tumkur, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VeraxionBengaluru, Karnataka, India
    We’re Hiring : Senior Data Engineer (Azure) We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across th...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tech MahindraTumkur, IN
    Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 2 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Wissen InfotechBengaluru, Karnataka, India
    Azure Data Engineer Know anyone who is interested!! Share your resumes to adilakshmi.Wissen Infotech is hiring for Bangalore. Job Title : Azure Data Engineer.Years of Experience : 8 plus years.Locatio...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    SystemBenderTumkur, IN
    Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 11 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    IQVIABengaluru, Karnataka, India
    Data Engineering, Python, Azure Databricks, Database, People management experience.Manages a team of professional-level employees. Develops and communicates plans and priorities to meet team perform...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    Capgemini InventBengaluru, Karnataka, India
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show moreLast updated: 12 hours ago
    • Promoted
    Senior Data Engineer -Azure Databricks

    Senior Data Engineer -Azure Databricks

    Tredence Inc.Bengaluru, Karnataka, India
    Loc : Bangalore / Chennai / Pune / Kolkata / Gurugram.Azure Databricks, Pyspark, SQL.Bachelor's and / or masters degree in computer science or equivalent experience. IT experience and experience in Data wareho...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AITumkur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Rainier Softech Solutions Pvt LtdBengaluru, Karnataka, India
    We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks.You’ll turn requirements into production-grade ELT / ETL jobs, Delta Lake tables, and reusable comp...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Pretium Enterprise Services, IndiaBengaluru, Karnataka, India
    Would be a lead responsible for developing data products & solutions for the organization.IT with experience in Data warehouse, ETL, BI projects is required. Would collaborate within Agile teams to ...Show moreLast updated: 14 days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersBangalore, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    ArcanaGreater Bengaluru Area, India
    Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show moreLast updated: 2 hours ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtreeBengaluru, Karnataka, India
    Seeking an experienced Senior Specialist with 7 to 11 years of expertise in Azure Data Factory and Azure SQL to design and manage scalable data integration solutions. Design develop and maintain sca...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Relevance LabBengaluru, Karnataka, India
    Job Description Design, build and maintain enterprise data models and data assets on Microsoft Azure to support analytics, reporting, ML / AI and data products. Translate business requirements into r...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer Technical Lead(Azure)

    Data Engineer Technical Lead(Azure)

    SigmoidGreater Bengaluru Area, India
    Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world’s leading data-rich organizations ...Show moreLast updated: 2 hours ago