Senior AI Platform DevOps Engineer

AI Platform DevOpes / SRE Engineer

Location : India - 100% Remote

Fulltime Permanent Position

Responsibilities / What You’ll Do

• Platform Design and Architecture : building and operating a highly available, scalable, modular AI platform using technologies such as Qdrant, Anyscale, and Ray to support LLM orchestration, vector search, and multi-agent frameworks.
• Core Infrastructure Development : Build essential APIs and infrastructure to power conversational applications, AI agents, and analytics tools.
• LLM Operational Solutions : Implement workflows for Large Language Models, including inference pipelines, fine-tuning, caching, and evaluation for open-weight and hosted models.
• Deployment & Performance Optimization : Deploy AI services on AWS with Kubernetes (EKS), Lambda, and ECS, ensuring scalability and resilience while optimizing vector databases and model runtimes for cost and performance.
• Collaboration, Governance, & Mentorship : Partner with engineering teams, research teams to deliver production-grade, self-healing, and performance-optimized services for AI / RAG pipelines , establish governance / security standards, and mentoring junior engineers in AI infrastructure best practices & reviews.

What We’re Looking for (Minimum Qualifications) :

Preferred Qualification :