Talent.com
Senior Data Engineer
Senior Data EngineerIncept Labs • guwahati, India
Senior Data Engineer

Senior Data Engineer

Incept Labs • guwahati, India
30+ days ago
Job description

Software Engineer (Data)

Remote, India

About us

Incept Labs is an AI research lab based in San Francisco, California. Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutions to enhance education and research. Backed by marquee investors and scientific collaborators, we believe in a future where humans and AI work together side by side. Together, AI processes knowledge at scale while humans contribute imagination, values, and lived experience, creating new ways to discover, adapt, and grow.

About This Role

We're looking for a Software Engineer with deep expertise in large-scale data processing for LLM development. Data engineering is critical to successful model training and evaluation. You'll work directly with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets.

You’ll join a high-impact, compact team responsible for both architecture and scaling of Incept’s data and model development infrastructure, and work with highly complex, multi-modal data.

Responsibilities

  • Design, build, and operate scalable, fault-tolerant data infrastructure to support distributed computing and data orchestration for LLM Research
  • Develop and maintain high-throughput systems for data ingestion, processing, and transformation to support LLM model development
  • Develop synthetic datasets using state-of-the-art solutions
  • Collaborate with research teams to deliver critical data assets for model development and evaluation
  • Implement and maintain monitoring and alerting to support platform reliability and performance
  • Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards

Required Qualifications

  • 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms.
  • Fluent in distributed computing frameworks.
  • Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster.
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing.
  • Extensive experience with performance optimization and memory management in high-volume data systems.
  • Proactive about documentation, automation, testing, and empowering your teammates with good tooling.
  • This role is fully remote, India-based. Compensation and benefits will vary based on background, skills, and experience levels.

    Create a job alert for this search

    Senior Data Engineer • guwahati, India

    Related jobs
    Data Engineer

    Data Engineer

    N53 Tech • Guwahati, Assam, India
    Our client is expanding their Data Engineering function and hiring across multiple levels (3 to 10 years).You will help build and scale their data architecture, data pipelines, data platform govern...Show more
    Last updated: 9 hours ago • Promoted • New!
    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    Peak Trust Global Real Estate • guwahati, assam, in
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 12 hours ago • Promoted • New!
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • guwahati, assam, in
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 16 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Turing • guwahati, assam, in
    Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers.You will be a key member of the Turing GenAI delivery organization and part of...Show more
    Last updated: 21 days ago • Promoted
    Data Analyst (Remote)

    Data Analyst (Remote)

    Generative Futures • guwahati, assam, in
    Remote
    We’re looking for an experienced Data Analyst to join an exciting US-based startup with excellent funding.This position will be fully remote, with flexibility around the timezone worked.In this rol...Show more
    Last updated: 10 days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    Upstep Academy • Guwahati, Assam, India
    About Upstep Academy Upstep Academy is a forward-thinking EdTech company dedicated to revolutionizing the world of chess education. We are building a cutting-edge learning platform that combines a w...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Data Science Engineer

    Senior Data Science Engineer

    Confidential • Guwahati, India
    INR 3000000-4000000 / year (based on experience).Full Time Permanent position(Payroll and Compliance to be managed by : Winmore). Note : This is a requirement for one of Uplers' client - Winmore).What...Show more
    Last updated: 18 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • guwahati, India
    We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Grantify • guwahati, assam, in
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 12 hours ago • Promoted • New!
    Senior Software Engineer

    Senior Software Engineer

    TechVerito • guwahati, assam, in
    Senior Consultant with experience in software development, system design, cloud technologies, LLMs and Agentic AI.This is a hands-on engineering role designed for individuals who thrive in collabor...Show more
    Last updated: 10 days ago • Promoted
    Senior LLM Engineer

    Senior LLM Engineer

    Infocusp Innovations • Guwahati, Assam, India
    About the Role The Senior Agentic AI Engineer will lead the design, development, and deployment of complex, autonomous agentic AI solutions within production environments, working across multi-age...Show more
    Last updated: 9 hours ago • Promoted • New!
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • guwahati, assam, in
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 17 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    People Prime Worldwide • guwahati, assam, in
    Our client is a Palo Alto–based AI infrastructure and talent platform founded in 2018.It helps companies connect with remote software developers using AI-powered vetting and matching technology.Ori...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    Leading MNC • guwahati, assam, in
    Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs. If you're looking for freelance / part time opportunity (along with your day...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    Confidential • Guwahati, India
    Confidential (based on experience).Full Time Permanent position(Payroll and Compliance to be managed by : Proplens).Note : This is a requirement for one of Uplers' client - Proplens).What do you need...Show more
    Last updated: 23 days ago • Promoted
    Senior Data Analyst

    Senior Data Analyst

    Eternz • Guwahati, Assam, India
    I'm looking for a Senior Data Analyst to be the analytical brain behind Eternz's growth strategy.About Eternz We're redefining how India buys jewelry. Eternz is India's #1 jewelry marketplace with...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • guwahati, assam, in
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 30+ days ago • Promoted
    Senior Java AWS Engineer

    Senior Java AWS Engineer

    Applicantz • guwahati, assam, in
    THIS IS A LONG TERM CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER.Candidate should be very good in Java and Spring. Must worked on complex system and ready to onboard quickly....Show more
    Last updated: 24 days ago • Promoted