Product Architect - AI / ML
Location : India / Offshore
Experience : 12-15 years (Minimum 6-7 years in AI / ML Product Architecture)
Location : -Pune preferred / Hyderabad (4 Days WFO)
Role Overview
Define and drive the technical product vision for enterprise AI / ML platforms in healthcare,
translating business requirements into scalable architectures while ensuring delivery
excellence and long-term product sustainability. This role requires hands-on leadership,
flexible collaboration across time zones, and the ability to mentor engineering teams.
Product & Technical Strategy
- Architect end-to-end product solutions for processing clinical records, claims, and
healthcare documentation
Design hybrid Azure / on-premises architectures supporting multi-tenant SaaS andenterprise deployment models
Establish product architecture principles, design patterns, and technology stackdecisions
Evaluate build-vs-buy decisions for AI capabilities, Drive technical feasibilityassessments and rapid prototyping for new product features
Own non-functional requirements : performance, security, compliance (HIPAA),scalability, reliability
Present architectural proposals and technical roadmaps to leadership through clearpresentations and documentation AI / ML Product Engineering
Design and implement fine-tuning pipelines for domain-specific LLMs (e.G. Llama,Mistral, Phi-3) on medical datasets
Architect MLOps frameworks enabling continuous model improvement : training,evaluation, deployment, monitoring
Build “built-in-intelligence-products” using advanced AI models.Implement distributed training infrastructure on Azure ML with GPU optimization(RTX5090 / 4090 / A100 / H100 clusters)
Create model evaluation frameworks with domain-specific metrics and qualitybenchmarks
Develop synthetic data generation capabilities for model training and testingEstablish model versioning, A / B testing, and rollback strategies for productiondeployments Platform & Infrastructure
Design microservices architectures with Azure Kubernetes Service, Service Bus, EventHubs for event-driven workflows
Build scalable data pipelines using Azure Data Factory, Synapse Analytics, Databricks forhigh-volume processing
Implement CI / CD automation through Azure DevOps with comprehensive testing anddeployment gates
Architect observability solutions : monitoring, logging, alerting, performance analyticsDesign hybrid cloud integration patterns connecting Azure services with on-premisessystems
Manage data architecture : Azure SQL, Cosmos DB, blob storage, data lakes with lifecyclepolicies Delivery Excellence & Hands-On Leadership
Lead proof-of-concept execution from inception to production-ready solutions withindefined timelines
Conduct rigorous code reviews ensuring adherence to standards, performanceoptimization, and maintainability
Roll up sleeves for critical implementation work : debugging production issues, optimizingmodel performance, refactoring complex modules
Deliver technical demos to internal stakeholders and customers showcasing productcapabilities
Establish engineering excellence standards : code quality, testing frameworks, peerreviews, documentation
Create comprehensive technical documentation : architecture decision records, APIcontracts, deployment guides
Identify and systematically address technical debt across AI models, infrastructure, andcodebase Team Development & Collaboration
Mentor and develop junior engineers and fresh graduates through pair programming, andtechnical guidance
Review and provide constructive feedback on designs, code, and technical approachesfrom team members
Foster engineering culture emphasizing quality, innovation, and continuous learningCollaborate with US-based teams requiring flexibility for meetings during early morning orlate evening IST hours
Bridge communication between offshore development teams and US-basedproduct / business stakeholders
Translate business requirements from US teams intoactionable technical tasks for India-based engineers
Participate in cross-timezone planning, sprint reviews, and architecture discussionsRequired Qualifications
[Non Negotiable] Expert Python development with PyTorch,Transformers, production ML frameworks
[Non Negotiable] Comfortable handlingNVIDIA / CUDA variants and their inner workings.
[Non Negotiable] Proven experience fine-tuning LLMs and deploying custom models inregulated environments
[Non Negotiable] Track record of shipping production AI productswith measurable business impact
[Non Negotiable] Core Software Engineering skills. AI / ML expertise, DevOps.[Non Negotiable] Flexibility to work with US hours overlap Key CompetencieHands-on technical leadership and a user-centric approach to technical architectureOwnership mindset with accountability for outcomes and the ability to balanceinnovation with pragmatic engineering
Effective communicator capable of engaging both technical and non-technical audiencesComfortable operating at multiple levels : strategy, architecture, and implementation