Talent.com
Senior Data Engineer
Senior Data EngineerIncept Labs • tirunelveli, India
No longer accepting applications
Senior Data Engineer

Senior Data Engineer

Incept Labs • tirunelveli, India
30+ days ago
Job description

Software Engineer (Data)

Remote, India

About us

Incept Labs is an AI research lab based in San Francisco, California. Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutions to enhance education and research. Backed by marquee investors and scientific collaborators, we believe in a future where humans and AI work together side by side. Together, AI processes knowledge at scale while humans contribute imagination, values, and lived experience, creating new ways to discover, adapt, and grow.

About This Role

We're looking for a Software Engineer with deep expertise in large-scale data processing for LLM development. Data engineering is critical to successful model training and evaluation. You'll work directly with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets.

You’ll join a high-impact, compact team responsible for both architecture and scaling of Incept’s data and model development infrastructure, and work with highly complex, multi-modal data.

Responsibilities

  • Design, build, and operate scalable, fault-tolerant data infrastructure to support distributed computing and data orchestration for LLM Research
  • Develop and maintain high-throughput systems for data ingestion, processing, and transformation to support LLM model development
  • Develop synthetic datasets using state-of-the-art solutions
  • Collaborate with research teams to deliver critical data assets for model development and evaluation
  • Implement and maintain monitoring and alerting to support platform reliability and performance
  • Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards

Required Qualifications

  • 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms.
  • Fluent in distributed computing frameworks.
  • Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster.
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing.
  • Extensive experience with performance optimization and memory management in high-volume data systems.
  • Proactive about documentation, automation, testing, and empowering your teammates with good tooling.
  • This role is fully remote, India-based. Compensation and benefits will vary based on background, skills, and experience levels.

    Create a job alert for this search

    Senior Data Engineer • tirunelveli, India

    Related jobs
    Data Engineer

    Data Engineer

    System Soft Technologies • Tirunelveli, Tamil Nadu, India
    Title : Data Engineer Location : Remote (3–4-hour time zone overlaps with EST if off shore) Duration : 6 months Musts : Python NextFlow Plus : Computer Vision Image Processing Project Overview : Exper...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer (DOMO & Python / Kafka)

    Data Engineer (DOMO & Python / Kafka)

    Smart Moves Consultants • Tirunelveli, Tamil Nadu, India
    JD : We are looking for candidates with strong Domo and Python / Kafka connect experience.Please find the JD below and share suitable and strong profiles at the earliest. Mode of working : RemoteEngagem...Show more
    Last updated: 3 hours ago • Promoted • New!
    Data Architect

    Data Architect

    Recro • tirunelveli, tamil nadu, in
    Central Data Office – Data Architect.SMEs, engineers, and developers to design and govern enterprise-level data architectures, ensuring alignment with corporate data principles and standards.This p...Show more
    Last updated: 23 days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • tirunelveli, tamil nadu, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 2 days ago • Promoted
    Senior Fullstack Engineer

    Senior Fullstack Engineer

    Black Dog Labs • tirunelveli, tamil nadu, in
    Senior Fullstack Engineer (with Data Engineering Experience).Remote (collaboration across time zones), India or LATAM preferred. Proficient English communication.Full-Stack Engineering / Backend Eng...Show more
    Last updated: 2 days ago • Promoted
    Full Stack Engineer (4-6 YOE)

    Full Stack Engineer (4-6 YOE)

    Redica Systems • tirunelveli, tamil nadu, in
    Redica Systems is a SaaS start-up serving more than 200 customers within the life science sector, with a specific focus on Pharmaceuticals and MedTech. Our workforce is distributed globally, with he...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Azoca Technologies • Tirunelveli, Republic Of India, IN
    We are seeking an experienced Data Engineer with strong hands-on expertise in Microsoft Fabric to design, build, and maintain scalable data solutions supporting global clients.The ideal candidate w...Show more
    Last updated: 5 hours ago • Promoted • New!
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Tirunelveli, Tamil Nadu, India
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • Tirunelveli, Tamil Nadu, India
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India)Salary : Up to 26 LPA️ Skills : Python, SQL, Big Data, Cloud, SnowflakeJob Description : We are looking for an experienced Data Enginee...Show more
    Last updated: 6 hours ago • Promoted • New!
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • Tirunelveli, Tamil Nadu, India
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Snowflake + Dbt Engineer

    Senior Snowflake + Dbt Engineer

    MindBrain • Tirunelveli, Republic Of India, IN
    Job Title : Snowflake + DBT Engineer.We are looking for an experienced Snowflake + DBT Engineer to design, build, and optimize our cloud-based data platform. The role involves developing scalable dat...Show more
    Last updated: 3 hours ago • Promoted • New!
    Data Center Engineer

    Data Center Engineer

    Estarta Solutions • tirunelveli, tamil nadu, in
    Job Title : Datacenter Engineer.Estarta is seeking a skilled Datacenter Engineer to support Cisco’s Customer Delivery Engineering function. The role focuses on delivering high-quality technical solut...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Turing • tirunelveli, tamil nadu, in
    Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers.You will be a key member of the Turing GenAI delivery organization and part of...Show more
    Last updated: 19 days ago • Promoted
    Data Engineer(Intern)

    Data Engineer(Intern)

    Tech Phoenix • tirunelveli, tamil nadu, in
    Tech Phoenix is a data science and AI startup that delivers cutting-edge solutions to clients across industries.We take on challenging projects ranging from advanced analytics and machine learning ...Show more
    Last updated: 1 day ago • Promoted
    Senior DevOps Engineer (SRE)

    Senior DevOps Engineer (SRE)

    MightyBot • tirunelveli, tamil nadu, in
    Title : Senior DevOps Engineer (SRE).Join our team as a Senior DevOps Engineer, where we're focused on graduating AI from interesting demos to indispensable products. You will build and maintain the ...Show more
    Last updated: 13 days ago • Promoted
    Data Integration Developer (Level 1)

    Data Integration Developer (Level 1)

    Blutic • tirunelveli, tamil nadu, in
    Data Integration Developer (Level 1).ETL processes and reports using.This entry-level role is ideal for developers looking to grow their skills in enterprise data solutions while contributing to cr...Show more
    Last updated: 13 days ago • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Torinit • tirunelveli, tamil nadu, in
    Machine Learning Engineer (3–5 Years Experience).Canadian-based digital consulting company.At Torinit, we don't just serve our clients. we work with them to create transformative digital journeys b...Show more
    Last updated: 5 days ago • Promoted
    Staff Software Engineer

    Staff Software Engineer

    BrightEdge • tirunelveli, tamil nadu, in
    Staff Software Engineer, Remote.The Software Engineer will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust and scalable data...Show more
    Last updated: 17 hours ago • Promoted • New!