Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

Incept Labspanchkula, haryana, in
2 days ago
Job description

Software Engineer (Data)

Remote, India

About us

Incept Labs is an AI research lab based in San Francisco, California. Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutions to enhance education and research. Backed by marquee investors and scientific collaborators, we believe in a future where humans and AI work together side by side. Together, AI processes knowledge at scale while humans contribute imagination, values, and lived experience, creating new ways to discover, adapt, and grow.

About This Role

We're looking for a Software Engineer with deep expertise in large-scale data processing for LLM development. Data engineering is critical to successful model training and evaluation. You'll work directly with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets.

You’ll join a high-impact, compact team responsible for both architecture and scaling of Incept’s data and model development infrastructure, and work with highly complex, multi-modal data.

Responsibilities

  • Design, build, and operate scalable, fault-tolerant data infrastructure to support distributed computing and data orchestration for LLM Research
  • Develop and maintain high-throughput systems for data ingestion, processing, and transformation to support LLM model development
  • Develop synthetic datasets using state-of-the-art solutions
  • Collaborate with research teams to deliver critical data assets for model development and evaluation
  • Implement and maintain monitoring and alerting to support platform reliability and performance
  • Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards

Required Qualifications

  • 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms.
  • Fluent in distributed computing frameworks.
  • Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster.
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing.
  • Extensive experience with performance optimization and memory management in high-volume data systems.
  • Proactive about documentation, automation, testing, and empowering your teammates with good tooling.
  • This role is fully remote, India-based. Compensation and benefits will vary based on background, skills, and experience levels.

    Create a job alert for this search

    Senior Data Engineer • panchkula, haryana, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadybaddi, himachal pradesh, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InCommonpanchkula, haryana, in
    InCommon is hiring on behalf of Podifi to support a Fortune 500 client on a large-scale database migration initiative.The project involves transitioning from Fivetran to Nexla, with Snowflake as th...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CareerXperts Consultingpanchkula, haryana, in
    We are looking for a highly skilled.The ideal candidate will have strong expertise in modern data engineering tools and frameworks, along with the ability to collaborate closely with data scientist...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladebaddi, himachal pradesh, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CESbaddi, himachal pradesh, in
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labsbaddi, himachal pradesh, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 2 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data Solutionsbaddi, himachal pradesh, in
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIChandigarh, India, India
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 13 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    Veltrispanchkula, haryana, in
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Confidential Jobsbaddi, himachal pradesh, in
    This role involves collaborating with cross-functional teams to ensure data reliability, scalability, and performance.The candidate will work closely with data scientists, analysts and software eng...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Net Zero Insightsbaddi, himachal pradesh, in
    Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide.Our cuttin...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIpanchkula, haryana, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 14 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIbaddi, himachal pradesh, in
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 17 hours ago
    • Promoted
    Staff / Senior Data Engineer

    Staff / Senior Data Engineer

    HG Insightsbaddi, himachal pradesh, in
    At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identif...Show moreLast updated: 2 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iobaddi, himachal pradesh, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Everisebaddi, himachal pradesh, in
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.baddi, himachal pradesh, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer [T500-18489]

    Senior Data Engineer [T500-18489]

    Albertsons Companies Indiapanchkula, haryana, in
    About Albertsons Companies India : .At Albertsons Companies India, we're not just pushing the boundaries of technology and retail innovation, we're cultivating a space where ideas flourish and career...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgebaddi, himachal pradesh, in
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDbaddi, himachal pradesh, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 2 days ago