Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Incept LabsCoimbatore, IN
17 days ago
Job description

Position : Software Engineer (Data)

Location : Remote, India

At Incept Labs, we believe the future of education and research lies in humans and AI working

together side by side. AI brings the ability to process knowledge at scale, while people

contribute imagination, values, and lived experience. When combined, they create a partnership

where each strengthens the other, opening new ways to discover, adapt, and grow.

We are a small team of scientists, engineers, and builders who are passionate about building

domain-specific, next-generation AI solutions to enhance education and research.

About This Role

We're looking for a Software Engineer with deep expertise in large-scale data processing for

LLM development. Data engineering is critical to successful model training and evaluation. You'll work directly with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets.

You’ll join a high-impact, compact team responsible for both architecture and scaling of Incept’s

data and model development infrastructure, and work with highly complex, multi-modal data.

Responsibilities

  • Design, build, and operate scalable, fault-tolerant data infrastructure to support

distributed computing and data orchestration for LLM Research

  • Develop and maintain high-throughput systems for data ingestion, processing, and
  • transformation to support LLM model development

  • Develop synthetic datasets using state-of-the-art solutions
  • Collaborate with research teams to deliver critical data assets for model development and evaluation
  • Implement and maintain monitoring and alerting to support platform reliability and performance
  • Build systems for traceability, reproducibility, and robust quality control to ensure adherence to industry compliance standards
  • Required Qualifications

  • 5+ years of experience in data infrastructure, ideally supporting high-scale applications or research platforms.
  • Fluent in distributed computing frameworks.
  • Deeply familiar with cloud infrastructure, data storage architectures, and batch + streaming pipelines.
  • Experience with specialized hardware (GPUs, TPUs) computing and GPU cluster.
  • Strong knowledge of databases, storage systems, and how architecture choices impact performance at scale.
  • Familiar with microservices architectures, containerization and orchestration, and both synchronous and asynchronous processing.
  • Extensive experience with performance optimization and memory management in high-volume data systems.
  • Proactive about documentation, automation, testing, and empowering your teammates with good tooling.
  • This role is fully remote, India-based. Compensation and benefits will vary based on background, skills, and experience levels.

    Create a job alert for this search

    Data Engineer • Coimbatore, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekCoimbatore, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaPalakkad, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsCoimbatore, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionCoimbatore, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 5 days ago
    • Promoted
    Rocket UniData Engineer

    Rocket UniData Engineer

    Mitra AITiruppur, IN
    The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Palakkad, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 23 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeTiruppur, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXCoimbatore, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AICoimbatore, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesCoimbatore, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EvolentCoimbatore, IN
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeCoimbatore, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data / ML Engineer

    Data / ML Engineer

    GleantapTiruppur, IN
    Gleantap is a customer engagement platform powering fitness, wellness, and service businesses.Python (scikit-learn, LightGBM, XGBoost). Set up retraining and monitoring pipelines (Airflow, MLflow, o...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseTiruppur, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 4 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsCoimbatore, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseTiruppur, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant only ( this is a Junior position with us ).GCP - 2 years minimum working Experience. Worked with global stakeholders.Randstad Sourc...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainCoimbatore, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalCoimbatore, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESTiruppur, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesPalakkad, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago