Talent.com
Senior Data Engineer

Senior Data Engineer

Tata Consultancy Serviceswest bengal, west bengal, in
17 days ago
Job description

Role : Senior Data Engineer

Experience : 8 plus Years

Location : Kolkata

Role

  • Senior Data Engineer

Required Technical Skill Set

Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI / CD, Data Governance, Purview, Informatica

Desired Competencies (Technical / Behavioral Competency)

Must-Have

  • Strong proficiency in Azure Data Factory, Databricks, Delta Live Tables
  • Solid experience with Python, SQL, YAML, and Terraform
  • Hands-on experience in building and optimizing scalable data pipelines
  • Expertise in Data Warehousing, Lakehouse Architecture, and Data Modelling
  • Knowledge of CI / CD practices and data governance tools like Purview or Informatica
  • Good-to-Have

  • Experience in Machine Learning integration and collaboration with data scientists
  • Knowledge of metadata management and observability frameworks
  • Strong stakeholder engagement and communication skills
  • Experience in Australian Energy or Utilities domain
  • Responsibility of / Expectations from the Role

    1 Design, build, and optimize scalable data pipelines using Azure Data Factory, Databricks, and Delta Live Tables.

    2 Implement ETL processes across diverse data assets ensuring data quality and performance.

    3 Develop and manage data warehouses and lakehouses for structured and semi-structured data.

    4 Ensure compliance with data security, governance, and privacy standards using Purview and Informatica.

    5 Collaborate with data scientists and ML engineers to operationalize machine learning pipelines.

    6 Implement CI / CD pipelines for automating data pipeline deployments.

    7 Translate complex technical solutions into business insights for stakeholders.

    8 Troubleshoot and resolve performance bottlenecks in data workflows.

    Create a job alert for this search

    Senior Data Engineer • west bengal, west bengal, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Serviceswest bengal, west bengal, in
    Job Location : Pan India - TCS Location.Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI / CD, Data Governance, Purview, Informatic...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticskolkata, India
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AccoladeKolkata, Republic Of India, IN
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIKolkata, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Inckolkata, India
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Integration Engineer

    Senior Data Integration Engineer

    Indsafrikolkata, India
    Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 14 days ago
    • Promoted
    Senior Aws Data Engineer

    Senior Aws Data Engineer

    CYAN360Kolkata, Republic Of India, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer-Remote

    Senior Data Engineer-Remote

    Cimpress Indiakolkata, India
    Remote
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labskolkata, India
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS)kolkata, India
    This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company. If you’re someone who takes initiative, val...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgekolkata, India
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKolkata, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy ServicesKolkata, West Bengal, India
    Required Technical Skill Set • •.Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI / CD, Data Governance, Purview, Informatica.Desire...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladekolkata, India
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 14 days ago
    • Promoted
    Senior Databricks Engineer

    Senior Databricks Engineer

    Tata Consultancy ServicesKolkata, Republic Of India, IN
    Role : Databricks Senior Developer.Role • •Databricks Senior Developer.Required Technical Skill Set • •Databricks, Spark and Data Migration experience. Desired Competencies (Technical / Behavioral Competen...Show moreLast updated: 17 days ago
    • Promoted
    Databricks Senior Developer

    Databricks Senior Developer

    Tata Consultancy Serviceswest bengal, west bengal, in
    Role : Databricks Senior Developer.Role • •Databricks Senior Developer.Required Technical Skill Set • •Databricks, Spark and Data Migration experience. Desired Competencies (Technical / Behavioral Competen...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivekolkata, India
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 14 days ago
    • Promoted
    • New!
    Lead Data Engineer (Azure, Databricks architecture, 8+yrs)

    Lead Data Engineer (Azure, Databricks architecture, 8+yrs)

    Innova ESIKolkata, IN
    Drive end to end integration delivery through analysis, design, build and deployment.Manage requirement gathering and analysis necessary for integration build. Develop new and enhanced integrations ...Show moreLast updated: 7 hours ago