Talent.com
No longer accepting applications
Data Engineer

Data Engineer

Jade Business Services (JBS)Thiruvananthapuram, IN
30+ days ago
Job description

Role : Data Engineer (AI Knowledge Base Platform)

Experience : 4 years to 7 years

Work location : Anywhere in India (Remote)

Notice period : Immediate to 15 days

Shift timing : 3 : 00 PM to 12 : 00 AM (IST)

Budget : As per market std

We are seeking a Data Engineer to design and maintain the ingestion, processing, and transformation pipelines that feed AI knowledge bases on GCP. The engineer will be responsible for ensuring reliable, scalable, and secure data movement across multiple sources, powering Retrieval-Augmented Generation (RAG) pipelines and automated agent deployment.

Required Skills & Qualifications :

  • 4+ years of Data engineering experience.
  • Strong programming skills in Python and SQL .
  • Proficiency with GCP data services : BigQuery, Cloud Storage, Dataflow, Pub / Sub, Composer / Airflow.
  • Experience with ETL / ELT pipeline design and workflow orchestration.
  • Familiarity with vector databases / embeddings (e.g., Pinecone, FAISS, Vertex AI Matching Engine).
  • Knowledge of data modeling, governance, and version control .
  • Experience with CI / CD, Docker, and Kubernetes for data pipeline deployment.
  • Strong analytical and debugging skills.

Key Responsibilities :

  • Design and implement data ingestion pipelines from GCS, BigQuery, and Google Drive.
  • Build workflows for knowledge base indexing / vectorization (RAG pipelines).
  • Implement incremental updates , targeted revisions, and full rebuild options for AI agents.
  • Collaborate with ML Engineers to integrate data pipelines with Vertex AI models .
  • Optimize pipelines for cost, performance, and scalability within GCP.
  • Ensure data quality, governance, and security with IAM-based access control.
  • Maintain logging, monitoring, and alerting for pipeline health.
  • Work with DevOps to enable self-healing and rollback automation .
  • About JBS :

    Jade Business Services (JBS) is a US-based company specializing in Data and Analytics solutions for industries such as Energy, Oil & Gas, Healthcare, and Finance. We help our customers become data-driven organizations by providing comprehensive data solutions, including Data Strategy, Data Governance, Advanced Analytics, Business Applications, and Data Visualization . Through our tailored approach and commitment to excellence, we drive digital transformation and build competitive advantages for our clients.

    Learn more about us at Jade Business Services LLC (jade-biz.com)

    Create a job alert for this search

    Data Engineer • Thiruvananthapuram, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeThiruvananthapuram, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXKollam, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseKollam, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionKollam, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 6 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradThiruvananthapuram, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 14 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGThiruvananthapuram, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Sikich IndiaKollam, IN
    Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalKollam, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response InformaticsKollam, IN
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIThiruvananthapuram, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Jaipur RugsKollam, IN
    Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIThiruvananthapuram, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 25 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Thiruvananthapuram, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsKollam, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 7 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncThiruvananthapuram, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 26 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc.Thiruvananthapuram, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 8 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    EXLThiruvananthapuram, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 16 days ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPThiruvananthapuram, IN
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago