AI / LLM Software Engineer

Job Description

• Design, develop, and deploy LLM-based applications for clinical and operational workflows (summarization, chat, reasoning, data extraction).
• Implement and optimize RAG (Retrieval-Augmented Generation) pipelines with vector databases (FAISS, Pinecone, or Vertex AI Matching Engine).
• Work hands-on with LLM APIs (OpenAI, Claude, Gemini, Mistral, Llama) for fine-tuning, evaluation, and productionization.
• Build and maintain AI microservices / APIs using FastAPI or Flask, integrated with Fold’s Unity platform.
• Implement Agentic AI workflows (multi-step reasoning, tool use, and task orchestration) using frameworks such as LangGraph, CrewAI, or Semantic Kernel.
• Collaborate with the Data Engineering and Product teams to ensure seamless integration of models with curated EHR and FHIR data.
• Conduct model evaluation and benchmarking (factual accuracy, hallucination control, latency).
• Follow HIPAA-compliant development practices and ensure PHI safety and responsible AI usage

Requirements

Must have :

Good to Have

Requirements