LLM & ML Ops Engineer

Summary

Gainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI / ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance monitoring, version control, and compliance while collaborating closely with Data Scientists, DevOps.

Your role in our mission

• Core LLM Ops Responsibilities :
• Develop and manage scalable deployment strategies specifically tailored for LLMs (GPT, Llama, Claude, etc.).
• Optimize LLM inference performance, including model parallelization, quantization, pruning, and fine-tuning pipelines.
• Integrate prompt management, version control, and retrieval-augmented generation (RAG) pipelines.
• Manage vector databases, embedding stores, and document stores used in conjunction with LLMs.
• Monitor hallucination rates, token usage, and overall cost optimization for LLM APIs or on-prem deployments.
• Continuously monitor models for its performance and ensure alert system in place.
• Ensure compliance with ethical AI practices, privacy regulations, and responsible AI guidelines in LLM workflows.
• Core ML Ops Responsibilities :
• Design, build, and maintain robust CI / CD pipelines for ML model training, validation, deployment, and monitoring.
• Implement version control, model registry, and reproducibility strategies for ML models.
• Automate data ingestion, feature engineering, and model retraining workflows.
• Monitor model performance, drift, and ensure proper alerting systems are in place.
• Implement security, compliance, and governance protocols for model deployment.
• Collaborate with Data Scientists to streamline model development and experimentation.

What we're looking for

What you should expect in this role

Skills Required

Python