Assistant Vice President– Generative AI – Systems Architect

Ready to shape the future of work?

At Genpact, we don’t just adapt to change—we drive it. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges.

If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that’s shaping the future, this is your moment.

Genpact (NYSE : G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation , our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook.

Inviting applications for the role of Assistant Vice President– Generative AI – Systems Architect

Role Overview : We are looking for an experienced Systems Architect with extensive experience in designing and scaling Generative AI systems to production. This role requires an individual with deep expertise in system architecture, software engineering, data platforms, and AI infrastructure, who can bridge the gap between data science, engineering and business.

You will be responsible for end-to-end architecture of Gen.AI systems including model lifecycle management, inference, orchestration, pipelines

Key Responsibilities :

Architect and design end-to-end systems for production-grade Generative AI applications (e.g., LLM-based chatbots, copilots, content generation tools).

Define and oversee system architecture covering data ingestion, model training / fine-tuning, inferencing, and deployment pipelines.

Establish architectural tenets like modularity, scalability, reliability, observability, and maintainability.

Collaborate with data scientists, ML engineers, platform engineers, and product managers to align architecture with business and AI goals.

Choose and integrate foundation models (open source or proprietary) using APIs, model hubs, or fine-tuned versions.

Evaluate and design solutions based on architecture patterns such as Retrieval-Augmented Generation (RAG), Agentic AI, Multi-modal AI, and Federated Learning.

Design secure and compliant architecture for enterprise settings, including data governance, auditability, and access control.

Lead system design reviews and define non-functional requirements (NFRs), including latency, availability, throughput, and cost.

Work closely with MLOps teams to define the CI / CD processes for model and system updates.

Contribute to the creation of reference architectures, design templates, and reusable components.

Stay abreast of the latest advancements in GenAI, system design patterns, and AI platform tooling.

Qualifications we seek in you!

Minimum Qualifications

Proven experience designing and implementing distributed systems, cloud-native architectures, and microservices.

Deep understanding of Generative AI architectures, including LLMs, diffusion models, prompt engineering, and model fine-tuning.

Strong experience with at least one cloud platform (AWS, GCP, or Azure) and services like SageMaker, Vertex AI, or Azure ML.

Experience with Agentic AI systems or orchestrating multiple LLM agents.

Experience with multimodal systems (e.g., combining image, text, video, and speech models).

Knowledge of semantic search, vector databases, and retrieval techniques in RAG.

Familiarity with Zero Trust architecture and advanced enterprise security practices.

Experience in building developer platforms / toolkits for AI consumption.

Contributions to open-source AI system frameworks or thought leadership in GenAI architecture.

Hands-on experience with tools and frameworks like LangChain, Hugging Face, Ray, Kubeflow, MLflow, or Weaviate / FAISS.

Knowledge of data pipelines, ETL / ELT, and data lakes / warehouses (e.g., Snowflake, BigQuery, Delta Lake).

Solid grasp of DevOps and MLOps principles, including containerization (Docker), orchestration (Kubernetes), CI / CD pipelines, and model monitoring.

Familiarity with system design tradeoffs in latency vs cost vs scale for GenAI workloads.

Preferred Qualifications :

Bachelor’s or Master’s degree in computer science, Engineering, or related field.

Experience in software / system architecture, with experience in GenAI / AI / ML.

Proven experience designing and implementing distributed systems, cloud-native architectures, and microservices.

Strong interpersonal and communication skills; ability to collaborate and present to technical and executive stakeholders.

Certifications in cloud platforms (e.g., AWS Certified Solutions Architect, Microsoft Certified : Azure Solutions Architect Expert, Google Cloud Professional Data Engineer).

Familiarity with data governance and security best practices.

Why join Genpact?

Be a transformation leader – Work at the cutting edge of AI, automation, and digital innovation

Make an impact – Drive change for global enterprises and solve business challenges that matter

Accelerate your career – Get hands-on experience, mentorship, and continuous learning opportunities

Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day

Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress

Come join the tech shapers and growth makers at Genpact and take your career in the only direction that matters : Up.

Let’s build tomorrow together.

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military / veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.

Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.