Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Jade Business Services (JBS)Kottayam, IN
30+ days ago
Job description

Role : Data Engineer (AI Knowledge Base Platform)

Experience : 4 years to 7 years

Work location : Anywhere in India (Remote)

Notice period : Immediate to 15 days

Shift timing : 3 : 00 PM to 12 : 00 AM (IST)

Budget : As per market std

We are seeking a Data Engineer to design and maintain the ingestion, processing, and transformation pipelines that feed AI knowledge bases on GCP. The engineer will be responsible for ensuring reliable, scalable, and secure data movement across multiple sources, powering Retrieval-Augmented Generation (RAG) pipelines and automated agent deployment.

Required Skills & Qualifications :

  • 4+ years of Data engineering experience.
  • Strong programming skills in Python and SQL .
  • Proficiency with GCP data services : BigQuery, Cloud Storage, Dataflow, Pub / Sub, Composer / Airflow.
  • Experience with ETL / ELT pipeline design and workflow orchestration.
  • Familiarity with vector databases / embeddings (e.g., Pinecone, FAISS, Vertex AI Matching Engine).
  • Knowledge of data modeling, governance, and version control .
  • Experience with CI / CD, Docker, and Kubernetes for data pipeline deployment.
  • Strong analytical and debugging skills.

Key Responsibilities :

  • Design and implement data ingestion pipelines from GCS, BigQuery, and Google Drive.
  • Build workflows for knowledge base indexing / vectorization (RAG pipelines).
  • Implement incremental updates , targeted revisions, and full rebuild options for AI agents.
  • Collaborate with ML Engineers to integrate data pipelines with Vertex AI models .
  • Optimize pipelines for cost, performance, and scalability within GCP.
  • Ensure data quality, governance, and security with IAM-based access control.
  • Maintain logging, monitoring, and alerting for pipeline health.
  • Work with DevOps to enable self-healing and rollback automation .
  • About JBS :

    Jade Business Services (JBS) is a US-based company specializing in Data and Analytics solutions for industries such as Energy, Oil & Gas, Healthcare, and Finance. We help our customers become data-driven organizations by providing comprehensive data solutions, including Data Strategy, Data Governance, Advanced Analytics, Business Applications, and Data Visualization . Through our tailored approach and commitment to excellence, we drive digital transformation and build competitive advantages for our clients.

    Learn more about us at Jade Business Services LLC (jade-biz.com)

    Create a job alert for this search

    Data Engineer • Kottayam, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesKochi, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalKochi, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncKochi, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXKochi, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IGT SolutionsAlappuzha, IN
    Interested candidate please share resume on Kalyani.Design, develop, and maintain scalable data pipelines using Python and PySpark. Work with SQL and MongoDB to manage and query large datasets.Devel...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    The Transformation GroupAlappuzha, IN
    The ideal candidate should possess experience with ETL, data and reporting; and contributing code to deliver new features and functionality. Day-to-day you will collaborate with engineers, product m...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeKottayam, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Forage AIAlappuzha, IN
    Experience Level : Data Engineer- 3- 7 years of relevant experience in data engineering.Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructu...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsKottayam, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainKochi, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseKottayam, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 22 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ATOM Systems Private LimitedKottayam, IN
    We are seeking a highly skilled and driven Data Engineering Lead to lead our data engineering team.The ideal candidate combines strong leadership and technical expertise with the ability to deliver...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    SapaadKochi, IN
    Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries. Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsKottayam, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyAlappuzha, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaKottayam, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisAlappuzha, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsKochi, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 23 days ago