Talent.com
No longer accepting applications
[Immediate Start] Senior Data Engineer

[Immediate Start] Senior Data Engineer

Persistent SystemsPune, Maharashtra, India
8 days ago
Job description

About Position :

We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong background in building production-grade Delta Live Tables (DLT) pipelines, implementing Medallion Architecture, and managing infrastructure using Terraform. This role demands hands-on experience in real-time data ingestion, structured streaming, and CI / CD practices. Familiarity with the Healthcare domain and Snowflake is a plus.

  • Role : Senior Data Engineer
  • Location : All Persistent Locations
  • Experience : 6+ Years
  • Job Type : Full Time Employment

What You'll Do :

  • Design, develop, and maintain scalable and robust Delta Live Tables (DLT) pipelines using Lakeflow Declarative Pipelines.
  • Architect and implement solutions based on Databricks Lakehouse Platform and Medallion Architecture. Ingest and process real-time data using Azure Event Hubs and Kafka endpoints.
  • Develop and optimize PySpark code for batch and streaming data pipelines.
  • Write comprehensive unit and integration tests using Pytest / unittest frameworks.
  • Process and transform semi-structured data formats, especially JSON.
  • Manage cloud infrastructure using Terraform for Azure resources.
  • Implement and maintain CI / CD pipelines using GitHub Actions.
  • Collaborate with cross-functional teams to ensure data quality, reliability, and performance.
  • Document technical solutions and maintain best practices across the data engineering lifecycle.
  • Expertise You'll Bring :

  • Expert-level proficiency in Azure Databricks and Delta Live Tables (DLT).
  • Deep understanding of Databricks Lakehouse Platform and Medallion Architecture.
  • Strong hands-on experience with Azure Event Hubs and Kafka for real-time ingestion.
  • Advanced knowledge of Apache Spark (PySpark) and structured streaming.
  • Proven experience in writing unit / integration tests for data pipelines.
  • Expertise in Python and SQL.
  • Experience in processing semi-structured data (JSON).
  • Strong Infrastructure as Code (IaC) skills using Terraform.
  • Proficiency in CI / CD tools, especially GitHub and GitHub Actions.
  • Benefits :

  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
  • Values-Driven, People-Centric & Inclusive Work Environment :

    Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

  • We support hybrid work and flexible hours to fit diverse lifestyles.
  • Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
  • If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
  • Let’s unleash your full potential at Persistent - persistent.com / careers

    “Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

    Create a job alert for this search

    Senior Data Engineer • Pune, Maharashtra, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MSBC GroupPune, Maharashtra, India
    As a Data Engineer, your primary role is to create and maintain high-performance data pipelines, warehouses, and cloud-based systems. This includes creating efficient batch and streaming pipelines, ...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer Lead [Immediate Start]

    Data Engineer Lead [Immediate Start]

    CoffeeBeansPune, Maharashtra, India
    Experience 5 - 8 yrs Mode of Working Hybrid (3 days WFO, 2 days WFH) Location Bangalore / Pune Roles and responsibilities- - Tech-lead in one of the feature teams, candidate need to be work ...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer_Immediate Joiners

    Data Engineer_Immediate Joiners

    VXI Global SolutionsPune, IN
    VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 17 days ago
    • Promoted
    Senior Azure data engineer- immediate joiner

    Senior Azure data engineer- immediate joiner

    Tata Consultancy ServicesPune, Maharashtra, India
    We are looking for Senior Azure data engineer cum Team lead in Pune location only.About the Role Senior Azure Data Engineer cum Lead Experience Range- 7-11 years Location-Pune Mandatory skill-A...Show moreLast updated: 17 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Pune, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfarsightPune, Maharashtra, India
    Infarsight helps enterprises scale strategic business transformation through automation, AI, and product innovation.We streamline operations with platforms like Task Sight, Trip Sight, and Fleet Si...Show moreLast updated: 30+ days ago
    • Promoted
    [Immediate Start] Azure Data Engineer

    [Immediate Start] Azure Data Engineer

    Persistent SystemsPune, Maharashtra, India
    About Position : We are seeking a skilled Data Engineer with hands-on experience in Azure Cloud technologies to join our dynamic data team. This role is ideal for someone passionate about building s...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Urgent Search : Senior Data Engineer

    Urgent Search : Senior Data Engineer

    Persistent SystemsPune, Maharashtra, India
    We are looking for an experienced Azure Databricks and Snowflake Data Engineer to lead and execute complex user migrations from legacy systems to modern cloud-based solutions.This role involves col...Show moreLast updated: 1 hour ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent SystemsPune, Maharashtra, India
    We are looking for an experienced Azure Databricks and Snowflake Data Engineer to lead and execute complex user migrations from legacy systems to modern cloud-based solutions.This role involves col...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Immediate Start! 2917 - Data Engineer

    Immediate Start! 2917 - Data Engineer

    EXLPune, Maharashtra, India
    Role Overview : The Data Engineer is responsible for designing, building, and optimizing data systems that power analytics, reporting, and machine learning across the organization.The role involves ...Show moreLast updated: less than 1 hour ago
    • Promoted
    • New!
    ▷ [Immediate Start] Snowflake Data Engineer (Snowflake+DBT+SQL+Python) Only Immediate Joiners- PAN I

    ▷ [Immediate Start] Snowflake Data Engineer (Snowflake+DBT+SQL+Python) Only Immediate Joiners- PAN I

    Mount Talent Consulting Pvt Ltd.Pune, Maharashtra, India
    As a Snowflake Lead with experience, and additional expertise in ETL tools and DBT, youwill be entrusted with a pivotal role in designing, implementing, and managing Snowflake solutions to driveeff...Show moreLast updated: less than 1 hour ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CoditasPune, Maharashtra, India
    Understand Business requirements and implement scalable solutions.Translate complex technical and functional requirements into detailed designs. Develop a highly scalable, reliable, and high-perform...Show moreLast updated: 30+ days ago
    • Promoted
    5447 | Senior Data Engineer

    5447 | Senior Data Engineer

    EXLpune, maharashtra, in
    We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIPune, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DataceriaPune, Maharashtra, India
    Dataceria software solutions Pvt ltd.Senior Data engineer _snowflake.Senior Data Engineer to join our growing.This is a critical role that will leverage cloud-based tools and provide thought leader...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer( DWH)

    Senior Data Engineer( DWH)

    MastercardPune, Maharashtra, India
    Mastercard is a global technology company in the payments industry.Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, ...Show moreLast updated: 16 days ago
    • Promoted
    ▷ (Immediate Start) Senior Data Engineer

    ▷ (Immediate Start) Senior Data Engineer

    RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS)Pune, Maharashtra, India
    We’re looking for a Senior Data Engineer to support our team in PAN India.This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to th...Show moreLast updated: 15 days ago