Talent.com
Senior Azure Data Engineer

Senior Azure Data Engineer

Tata Consultancy Servicessrikakulam, andhra pradesh, in
3 hours ago
Job description

Greetings from TCS!

Job Title : Senior Azure Data Engineer

Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL.

Location : Gurugram

Experience Range : 6-8 years

Job Description

Must-Have

  • Good Knowledge of Data Brick lakehouse and Azure DataLake concept
  • Knowledge of Data Bricks delta concept
  • Delta live tables (DLT)
  • Strong hands-on experience in ELT– pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
  • Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic
  • In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool.
  • Experience with data transformation using Spark, and SQL technologies.
  • Solid understanding of design patterns, and best practices of the cloud stack.
  • Experience with code management and version control using Git or similar tools.
  • Strong problem-solving and debugging skills in ETL workflows and data pipelines.
  • Strong understanding of Azure Data bricks and Azure Synapse internals – features and capabilities.
  • Knowledge of Azure DevOps and continuous integration and deployment (CI / CD) process.
  • Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing

Good To Have :

  • Power Shell Knowledge
  • Power BI Knowledge
  • Responsibility of / Expectations from the Role :

  • Conducting technical sessions, design reviews, code reviews, and demos of pipelines and their functionality
  • Developing technical specification for Data pipelines and workflow and getting sign-off from Architect and Stryker leads.
  • Developing, deploying, and maintaining workflows and data pipelines using Azure Data bricks and Azure Synapse.
  • Developing pipeline / notebook for Delta live tables ( DLT) Databricks Auto Loader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
  • Writing efficient and high-performing ETL code using PySpark, and SQL technologies.
  • Thanks & Regards,

    Ria Aarthi A.

    Create a job alert for this search

    Azure Data Engineer • srikakulam, andhra pradesh, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    American Inferencesrikakulam, andhra pradesh, in
    Please apply directly through LinkedIn for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.We are an AI and Data ...Show moreLast updated: 14 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    SystemBendersrikakulam, andhra pradesh, in
    Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    Sigmoidsrikakulam, andhra pradesh, in
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show moreLast updated: 3 hours ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Servicessrikakulam, andhra pradesh, in
    TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services). Strong expertise in Azure Data Engineering & ETL Co...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Cosrikakulam, andhra pradesh, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Adaptive Technology Insightssrikakulam, andhra pradesh, in
    We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show moreLast updated: 3 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyatisrikakulam, andhra pradesh, in
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    TEKsystems Global Services in Indiasrikakulam, andhra pradesh, in
    Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Fornaxsrikakulam, andhra pradesh, in
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 3 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Masteksrikakulam, India
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 14 days ago
    • Promoted
    (Senior) Azure Data Engineer - Full Remote - Contractor In Usd

    (Senior) Azure Data Engineer - Full Remote - Contractor In Usd

    All European CareersChicacole, Republic Of India, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Senior DataOps Engineer (AWS)

    Senior DataOps Engineer (AWS)

    MSBC Groupsrikakulam, andhra pradesh, in
    Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 3 hours ago
    • Promoted
    Sr Azure Data Engineer - Remote Work

    Sr Azure Data Engineer - Remote Work

    techolutionChicacole, Republic Of India, IN
    Remote
    The ideal candidate will have a strong foundation in.Job Title : Azure Data Engineer.Work Timings : 5 : 00 PM to 2 : 00 AM IST. If your expertise is primarily in.Lead the migration of large-scale SQL work...Show moreLast updated: 16 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    People Prime Worldwidesrikakulam, andhra pradesh, in
    Azure Data Lake Storage (Gen1 / Gen2).Show moreLast updated: 30+ days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careerssrikakulam, andhra pradesh, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 2 days ago
    • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek Consultingsrikakulam, India
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    Capgemini Inventsrikakulam, andhra pradesh, in
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show moreLast updated: 3 hours ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tech Mahindrasrikakulam, andhra pradesh, in
    Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 1 day ago