Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

Incept Labsthoothukudi, tamil nadu, in
10 days ago
Job description

Software Engineer (Data)

Remote, India

About us

Incept Labs is an AI research lab based in San Francisco, California. Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutions to enhance education and research. Backed by marquee investors and scientific collaborators, we believe in a future where humans and AI work together side by side. Together, AI processes knowledge at scale while humans contribute imagination, values, and lived experience, creating new ways to discover, adapt, and grow.

About This Role

We're looking for a Software Engineer with deep expertise in large-scale data processing for LLM development. Data engineering is critical to successful model training and evaluation. You'll work directly with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets.

You’ll join a high-impact, compact team responsible for both architecture and scaling of Incept’s data and model development infrastructure, and work with highly complex, multi-modal data.

Responsibilities

  • Design, build, and operate scalable, fault-tolerant data infrastructure to support distributed computing and data orchestration for LLM Research
  • Develop and maintain high-throughput systems for data ingestion, processing, and transformation to support LLM model development
  • Develop synthetic datasets using state-of-the-art solutions
  • Collaborate with research teams to deliver critical data assets for model development and evaluation
  • Implement and maintain monitoring and alerting to support platform reliability and performance
  • Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards

Required Qualifications

  • 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms.
  • Fluent in distributed computing frameworks.
  • Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster.
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing.
  • Extensive experience with performance optimization and memory management in high-volume data systems.
  • Proactive about documentation, automation, testing, and empowering your teammates with good tooling.
  • This role is fully remote, India-based. Compensation and benefits will vary based on background, skills, and experience levels.

    Create a job alert for this search

    Senior Data Engineer • thoothukudi, tamil nadu, in

    Related jobs
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    AAA GlobalThoothukudi, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 11 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    The Mastermind GroupThoothukudi, IN
    Remote (India) – Occasional travel to Riyadh, KSA.Sunday–Thursday preferred (9 AM – 5 PM IST).About The Mastermind Group (TMG). Software Asset Management (SAM).Hardware Asset Management (HAM).We're ...Show moreLast updated: 30+ days ago
    • Promoted
    Fabric Platform Data Architect (Remote)

    Fabric Platform Data Architect (Remote)

    Thinkgrid LabsThoothukudi, IN
    Remote
    Thinkgrid Labs is at the forefront of innovation and technology.Our expert team of software engineers, architects, and UI / UX designers specialises in crafting bespoke web, mobile, cloud application...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyThoothukudi, IN
    Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Lead Data Engineer

    Senior Lead Data Engineer

    TerraFinn Technologiesthoothukudi, tamil nadu, in
    TerraFinn Technologies outsources scholars from various top business schools in India and experienced employees to Fintech companies globally. The company focuses on providing expert employees to he...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutionstirunelveli, tamil nadu, in
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 10 days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    DNA Technology Servicestirunelveli, tamil nadu, in
    We are looking for an experienced.The ideal candidate will have strong expertise in Snowflake, cloud platforms (AWS / Azure), and modern data engineering practices, with the ability to design and imp...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Sikich Indiathoothukudi, tamil nadu, in
    Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicestirunelveli, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 19 days ago
    • Promoted
    Data Architect

    Data Architect

    Mindfire SolutionsThoothukudi, IN
    We are seeking a highly skilled and strategic Data Architect to design, develop, and manage the organisation’s data architecture. The ideal candidate will ensure that data assets are structured, int...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    KPG99 INCThoothukudi, IN
    Essential Skills and requirements.Advanced proficiency in SQL including stored procedures, views and functions.Solid knowledge of data warehousing principles. Experience working with large data ware...Show moreLast updated: 11 hours ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticsthoothukudi, tamil nadu, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 20 days ago
    • Promoted
    Data Architect

    Data Architect

    G10XThoothukudi, IN
    Senior Data Architect (15+ Years Experience).We are looking for a seasoned Data Architect to lead and shape enterprise-wide data initiatives. This role requires a strategic leader with deep technica...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tekshiras Software Services Private Limitedthoothukudi, tamil nadu, in
    We’re Hiring – Senior Data Engineer (10+ Years Experience).We are looking for a seasoned professional with strong expertise in Data Engineering, Data Analysis, SQL and ML / Gen AI.The ideal candidate...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineering Role

    Data Engineering Role

    100x.incThoothukudi, IN
    At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 10 days ago
    • Promoted
    Data Architect

    Data Architect

    Infogaintirunelveli, tamil nadu, in
    Design, develop, and optimize scalable data pipelines and workflows using Databricks and Apache Spark on AWS.Collaborate with data scientists, analysts, and other stakeholders to transform data int...Show moreLast updated: 19 days ago
    • Promoted
    • New!
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Servicestirunelveli, tamil nadu, in
    Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 9 hours ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    AaysThoothukudi, IN
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseThoothukudi, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 21 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    PASO Cothoothukudi, tamil nadu, in
    We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 9 hours ago