Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Jade Business Services (JBS)madurai, tamil nadu, in
30+ days ago
Job description

Role : Data Engineer (AI Knowledge Base Platform)

Experience : 4 years to 7 years

Work location : Anywhere in India (Remote)

Notice period : Immediate to 15 days

Shift timing : 3 : 00 PM to 12 : 00 AM (IST)

Budget : As per market std

We are seeking a Data Engineer to design and maintain the ingestion, processing, and transformation pipelines that feed AI knowledge bases on GCP. The engineer will be responsible for ensuring reliable, scalable, and secure data movement across multiple sources, powering Retrieval-Augmented Generation (RAG) pipelines and automated agent deployment.

Required Skills & Qualifications :

  • 4+ years of Data engineering experience.
  • Strong programming skills in Python and SQL .
  • Proficiency with GCP data services : BigQuery, Cloud Storage, Dataflow, Pub / Sub, Composer / Airflow.
  • Experience with ETL / ELT pipeline design and workflow orchestration.
  • Familiarity with vector databases / embeddings (e.g., Pinecone, FAISS, Vertex AI Matching Engine).
  • Knowledge of data modeling, governance, and version control .
  • Experience with CI / CD, Docker, and Kubernetes for data pipeline deployment.
  • Strong analytical and debugging skills.

Key Responsibilities :

  • Design and implement data ingestion pipelines from GCS, BigQuery, and Google Drive.
  • Build workflows for knowledge base indexing / vectorization (RAG pipelines).
  • Implement incremental updates , targeted revisions, and full rebuild options for AI agents.
  • Collaborate with ML Engineers to integrate data pipelines with Vertex AI models .
  • Optimize pipelines for cost, performance, and scalability within GCP.
  • Ensure data quality, governance, and security with IAM-based access control.
  • Maintain logging, monitoring, and alerting for pipeline health.
  • Work with DevOps to enable self-healing and rollback automation .
  • About JBS :

    Jade Business Services (JBS) is a US-based company specializing in Data and Analytics solutions for industries such as Energy, Oil & Gas, Healthcare, and Finance. We help our customers become data-driven organizations by providing comprehensive data solutions, including Data Strategy, Data Governance, Advanced Analytics, Business Applications, and Data Visualization . Through our tailored approach and commitment to excellence, we drive digital transformation and build competitive advantages for our clients.

    Learn more about us at Jade Business Services LLC (jade-biz.com)

    Create a job alert for this search

    Data Engineer • madurai, tamil nadu, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    TalogyDindigul, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseDindigul, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Forage AIMadurai, IN
    Experience Level : Data Engineer- 3- 7 years of relevant experience in data engineering.Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructu...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncMadurai, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaDindigul, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    SapaadDindigul, IN
    Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries. Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IGT SolutionsMadurai, IN
    Interested candidate please share resume on Kalyani.Design, develop, and maintain scalable data pipelines using Python and PySpark. Work with SQL and MongoDB to manage and query large datasets.Devel...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Magma ConsultancyDindigul, IN
    Part-time (20–25 hours per week).The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers,...Show moreLast updated: 11 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesDindigul, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXDindigul, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    NAF Technology IndiaDindigul, IN
    Do you love a Challenge? Are you Passionate about technology? Are you customer obsessed? Looking to innovate? Join NAF Tech! New American Funding (NAF) is a mortgage lender offering an array of loa...Show moreLast updated: 11 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    SynechronDindigul, IN
    We have immediate opportunity for AWS.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technolog...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    AptologicsDindigul, IN
    Aptologics is a global Data & AI company that simplifies complex data, builds scalable analytics platforms, and operationalizes AI to drive measurable outcomes. We deliver tailored solutions that he...Show moreLast updated: 11 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalMadurai, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    StraiveMadurai, IN
    Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs.The ideal candidate will ...Show moreLast updated: 11 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsMadurai, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 24 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Tytan Technology Inc.Dindigul, IN
    Please apply directly or send your resume to.The ideal candidate will have deep expertise in.Design and develop scalable, efficient, and reliable. Architect and implement modern.Work closely with bu...Show moreLast updated: 11 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsMadurai, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsMadurai, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisMadurai, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 2 days ago