Talent.com
No longer accepting applications
Senior Azure Data Engineer

Senior Azure Data Engineer

Tata Consultancy ServicesAnand, IN
2 days ago
Job description

Greetings from TCS!

Job Title : Senior Azure Data Engineer

Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL.

Location : Gurugram

Experience Range : 6-8 years

Job Description

Must-Have

  • Good Knowledge of Data Brick lakehouse and Azure DataLake concept
  • Knowledge of Data Bricks delta concept
  • Delta live tables (DLT)
  • Strong hands-on experience in ELT– pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
  • Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic
  • In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool.
  • Experience with data transformation using Spark, and SQL technologies.
  • Solid understanding of design patterns, and best practices of the cloud stack.
  • Experience with code management and version control using Git or similar tools.
  • Strong problem-solving and debugging skills in ETL workflows and data pipelines.
  • Strong understanding of Azure Data bricks and Azure Synapse internals – features and capabilities.
  • Knowledge of Azure DevOps and continuous integration and deployment (CI / CD) process.
  • Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing

Good To Have :

  • Power Shell Knowledge
  • Power BI Knowledge
  • Responsibility of / Expectations from the Role :

  • Conducting technical sessions, design reviews, code reviews, and demos of pipelines and their functionality
  • Developing technical specification for Data pipelines and workflow and getting sign-off from Architect and Stryker leads.
  • Developing, deploying, and maintaining workflows and data pipelines using Azure Data bricks and Azure Synapse.
  • Developing pipeline / notebook for Delta live tables ( DLT) Databricks Auto Loader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
  • Writing efficient and high-performing ETL code using PySpark, and SQL technologies.
  • Thanks & Regards,

    Ria Aarthi A.

    Create a job alert for this search

    Azure Data Engineer • Anand, IN

    Related jobs
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    SystemBenderAnand, IN
    Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 12 days ago
    • Promoted
    Senior Cloud Engineer(Azure)

    Senior Cloud Engineer(Azure)

    Exigo TechVadodara, Gujarat, India
    Exigo Tech specialises in proving end-to-end technology solutions in Infrastructure, Cloud, Enterprise Application Development, Networks and Internet, Digital Transformation, Business Communication...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasVadodara, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 18 days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersVadodara, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 4 days ago
    • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Incnadiad, gujarat, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 18 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group IncVadodara, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show moreLast updated: 4 days ago
    • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran SystemsAhmedabad, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show moreLast updated: 4 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tech MahindraNadiad, IN
    Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 3 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    COVET IT INCVadodara, IN
    Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show moreLast updated: 1 day ago
    • Promoted
    Senior DataOps Engineer (AWS)

    Senior DataOps Engineer (AWS)

    MSBC GroupAhmedabad, Gujarat, India
    Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroVadodara, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeVadodara, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer-IDMC

    Senior Data Engineer-IDMC

    Digivance SolutionsAnand, IN
    Data Ingestion, IDMC, Big Data Technology.We are seeking a skilled Data Engineer with strong experience in data ingestion, pipeline development, and working with cloud and big data technologies.The...Show moreLast updated: 13 hours ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Anand, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / GCP)

    Senior Data Engineer (AWS / GCP)

    ArmakuniAhmedabad, Gujarat, India
    We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results.If you are a tea...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    AdvantmedAhmedabad, Gujarat, India
    Lead Data Engineer – Azure Cloud.We are looking for an experienced.The ideal candidate will design, develop, and maintain scalable data pipelines, ensure data quality, and leverage cloud technologi...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIVadodara, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MindlanceAnand, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 2 days ago