Talent.com
No longer accepting applications
Senior Azure Data Engineer

Senior Azure Data Engineer

Tata Consultancy ServicesKochi, IN
2 days ago
Job description

Greetings from TCS!

Job Title : Senior Azure Data Engineer

Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL.

Location : Gurugram

Experience Range : 6-8 years

Job Description

Must-Have

  • Good Knowledge of Data Brick lakehouse and Azure DataLake concept
  • Knowledge of Data Bricks delta concept
  • Delta live tables (DLT)
  • Strong hands-on experience in ELT– pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
  • Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic
  • In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool.
  • Experience with data transformation using Spark, and SQL technologies.
  • Solid understanding of design patterns, and best practices of the cloud stack.
  • Experience with code management and version control using Git or similar tools.
  • Strong problem-solving and debugging skills in ETL workflows and data pipelines.
  • Strong understanding of Azure Data bricks and Azure Synapse internals – features and capabilities.
  • Knowledge of Azure DevOps and continuous integration and deployment (CI / CD) process.
  • Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing

Good To Have :

  • Power Shell Knowledge
  • Power BI Knowledge
  • Responsibility of / Expectations from the Role :

  • Conducting technical sessions, design reviews, code reviews, and demos of pipelines and their functionality
  • Developing technical specification for Data pipelines and workflow and getting sign-off from Architect and Stryker leads.
  • Developing, deploying, and maintaining workflows and data pipelines using Azure Data bricks and Azure Synapse.
  • Developing pipeline / notebook for Delta live tables ( DLT) Databricks Auto Loader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
  • Writing efficient and high-performing ETL code using PySpark, and SQL technologies.
  • Thanks & Regards,

    Ria Aarthi A.

    Create a job alert for this search

    Azure Data Engineer • Kochi, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    RecroKochi, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Architect- Snowflake

    Senior Data Architect- Snowflake

    USEReadyKottayam, IN
    USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer- Freelance

    Senior Data Engineer- Freelance

    Quapton AI SolutionsKottayam, IN
    Quapton AI Solutions is an innovative tech startup dedicated to providing advanced IT services within the field of artificial intelligence. We aim to empower businesses with tailored AI-driven solut...Show moreLast updated: 1 day ago
    • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran SystemsKottayam, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdKochi, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 2 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    SystemBenderKochi, IN
    Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MindlanceKochi, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Senior Data Engineer-IDMC

    Senior Data Engineer-IDMC

    Digivance SolutionsKottayam, IN
    Data Ingestion, IDMC, Big Data Technology.We are seeking a skilled Data Engineer with strong experience in data ingestion, pipeline development, and working with cloud and big data technologies.The...Show moreLast updated: 16 hours ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersKochi, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasKottayam, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneKottayam, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 18 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Kottayam, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tech MahindraKochi, IN
    Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 3 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Techmax TechnologiesKochi, Kerala, India
    At Techmax Technologies, we’re transforming the automotive industry through cutting-edge data analytics, customer experience innovations, and digital solutions. Since 2020, we’ve partnered with deal...Show moreLast updated: 12 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    COVET IT INCKottayam, IN
    Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiKochi, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 4 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group IncKochi, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show moreLast updated: 4 days ago
    • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL DigitalKottayam, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show moreLast updated: 9 days ago