Talent.com
AI Infrastructure & Automation Architect

AI Infrastructure & Automation Architect

RecroHaryāna, Republic Of India, IN
13 hours ago
Job description

Overview

Own the end-to-end architecture of production AI systems with a strong hands-on bias. You’ll design robust, cost-efficient, and secure agentic / GenAI solutions on AWS. Part of your job will be to unblock lead developers by debugging code, optimizing performance, and guiding best practices. Expect to turn complex requirements into scalable, observable, and well-governed platforms.

Responsibilities

  • Define target architectures for agentic systems (planning / reasoning / tool-calling), GenAI / RAG pipelines, and evaluation loops;

produce clear design documents with Flow / UML / sequence diagrams and AWS deployment topologies.

  • Size and optimize infrastructure for cost and performance : model throughput / latency, concurrency, autoscaling policies, CPU / GPU needs, memory footprints, vector index sizing, storage / egress, and token budgets.
  • Lead deep-dive debugging and incident resolution : profile bottlenecks, fix defects, stabilize services;
  • pair-program with developers to raise the engineering bar.

  • Establish reference implementations for multi-agent frameworks (Semantic Kernel preferred;
  • LangGraph / AutoGen / CrewAI acceptable), tool / function schemas, validation, memory, grounding, and multi-step planning.

  • Architect retrieval and hybrid search systems : ingestion, chunking, embeddings, ranking, caching, freshness, and grounding;
  • evaluate recall, precision, and hallucination risk.

  • Productionize on AWS using Amazon EKS, S3, SQS / SNS, and AWS Bedrock;
  • integrate identity (Okta / IAM), secrets (AWS Secrets Manager), eventing, and observability;
  • enforce SLIs / SLOs and error budgets.

  • Make systems observable : distributed tracing, metrics, and logs using OpenTelemetry and Datadog;
  • standardize dashboards,alerts, and tool / trace replay.

  • Build evaluation and promotion workflows : prompt / flow tests, golden sets, offline batch runs, A / B experiments, regression suites, and rollout gates.
  • Design security and safety controls : threat modeling, prompt-injection defense, sandboxed tools, policy enforcement, red-team testing, PII / data governance, and audit trails.
  • Define platform standards : reusable SDKs, connectors, CI / CD templates, runbooks, and architecture review checklists.
  • Partner with product, data, and SRE teams to plan capacity, disaster recovery, multi-region posture, and upgrade paths;
  • lead readiness reviews and post-incident RCAs.

  • Mentor engineers and review PRs with a focus on reliability, correctness, and maintainability.
  • Must Have

  • 7–10 years in software / AI engineering with at least 4+ years building GenAI applications and 2+ years architecting production agentic systems.
  • Strong hands-on expertise in Python 3.11+ (typing, asyncio, packaging, profiling, pytest);
  • able to dive into code,fix bugs, and optimize performance-critical paths.

  • Experience with one or more agent frameworks (Semantic Kernel, LangGraph, AutoGen, CrewAI) and function / tool calling with schema and argument validation.
  • Proven design of GenAI / RAG / hybrid retrieval systems using AWS Bedrock, OpenSearch Serverless, or other vector databases;
  • grounding and retrievalevaluation experience.

  • Deep knowledge of AWS architecture : Amazon EKS, Bedrock, S3, SQS / SNS, RDS (SQL Server / PostgreSQL), ElastiCache (Redis), Secrets Manager, IAM / Okta, Kong API Gateway, OpenSearch Serverless, and Datadog.
  • Observability expertise : distributed tracing (OpenTelemetry), metrics, logs, correlation IDs, and service-level objectives;
  • mature incident response and on-call practices.

  • Cost and performance engineering mindset : capacity modeling, GPU / CPU sizing, autoscaling (HPA), batching / streaming, caching, and FinOps discipline.
  • Security and safety fundamentals : least privilege, data isolation, policy enforcement, content moderation, jailbreak / PII defenses, and compliance awareness.
  • Excellent technical communication : clear diagrams, ADRs, design docs;
  • empathetic, structured code and architecture reviews.

    Good to Have

  • Multi-agent orchestration patterns : task decomposition, coordinator-worker, human-in-the-loop, graph-based planning.
  • Deep expertise with vector databases and retrieval : OpenSearch Serverless, Pinecone, pgvector, Redis.
  • Evaluation frameworks : red teaming, automated guardrails, regression testing, rollout gates, canary deployments.
  • Frontend integration for agent UIs (streaming responses, tool traces), secure connector APIs, and AuthN / Z best practices.
  • Policy-as-code (OPA) and multi-tenant architecture (RBAC, quotas, usage metering).
  • Knowledge of Kong API Gateway, LaunchDarkly / Flipt for feature management, and NeMo Guardrails for runtime safety.
  • CI / CD exposure (build / test with GitHub Actions, deployments via Terraform / AWS IaC templates).
  • Core Tech Stack (our core;
  • equivalents welcome)

  • Python 3.11+, FastAPI, Pydantic v2, SQLAlchemy 2.X, Alembic, pytest.
  • Amazon EKS, AWS Bedrock, Amazon SQS / SNS, Amazon RDS (SQL Server / PostgreSQL), ElastiCache (Redis).
  • Amazon S3 for storage, Amazon ECR for container images, OpenSearch Serverless for vector storage.
  • AWS Secrets Manager, Okta IAM, NeMo Guardrails, Kong API Gateway.
  • OpenTelemetry + Datadog for observability and monitoring.
  • Custom RAG Services, Bedrock Knowledge Base, and LLM evaluation with Phoenix, Arize, and Promptfoo.
  • Create a job alert for this search

    Automation Architect • Haryāna, Republic Of India, IN

    Related jobs
    • Promoted
    • New!
    Data Architect – AI Platform

    Data Architect – AI Platform

    Birdeyeharyana, haryana, in
    Job Title : Data Architect – AI Platform.Department : Engineering / Data Platform.This role is central to building the.You’ll architect and implement the systems that transform raw data into.You won’...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    AI Architect

    AI Architect

    KPMG Indiaharyana, haryana, in
    KPMG Delivery Network India (KDNI) is a diverse entity spread across multiple cities in India.We are an important part of the KPMG Delivery Network (KDN), a global organization that supports KPMG m...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    AI Systems Architect

    AI Systems Architect

    RecroHaryāna, Republic Of India, IN
    This is a highly hands-on role requiring deep architectural insight, coding proficiency, and an obsession with performance, scalability, and reliability. You’ll architect secure, cost-efficient AI p...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    AI Solutions Architect

    AI Solutions Architect

    PBPartnersHaryāna, Republic Of India, IN
    AI Tech Lead who is first a builder, and second a product translator.AI-powered solutions that directly impact PB Partners’ agent network, customer journeys, and internal operations.Build AI applic...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Lead AI Infrastructure Engineer

    Lead AI Infrastructure Engineer

    McCain FoodsHaryāna, Republic Of India, IN
    Sr Engineering Manager – Infrastructure AI, Automation & Tools.Our Global Technology team’s goal is to leverage technology and data to drive profitable growth, focus on enhancing customer experienc...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Senior Architect, Generative AI and AI Agent Factory

    Senior Architect, Generative AI and AI Agent Factory

    PepsiCoharyana, haryana, in
    The Senior Technical Architect – Generative AI and Agent Factory is responsible for leading the end-to-end architecture, design, and strategic enablement of PepsiCo's enterprise-grade GenAI platfor...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    AI Systems Architecture Lead

    AI Systems Architecture Lead

    RecroHaryāna, Republic Of India, IN
    Own the end-to-end architecture of production AI systems with a strong hands-on bias.You’ll design robust, cost-efficient, and secure agentic / GenAI solutions on AWS. Part of your job will be to unbl...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Ai Tech Architect

    Ai Tech Architect

    RecroHaryāna, Republic Of India, IN
    Own the end-to-end architecture of production AI systems with a strong hands-on bias.You’ll design robust, cost-efficient, and secure agentic / GenAI solutions on AWS. Part of your job will be to unbl...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Agentic AI Architect

    Agentic AI Architect

    Infinit-Oharyana, haryana, in
    This role is deeply technical, requiring hands-on expertise in automation platforms, system integration, and architectural leadership to deliver intelligent, scalable, and future-ready automation f...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Infrastructure Architect

    Infrastructure Architect

    FNZHaryāna, Republic Of India, IN
    This role is technical in nature and is responsible for providing high quality and timely IT infrastructure support to ensure the availability, stability and performance the FNZ datacentres, platfo...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    AI Data Architect

    AI Data Architect

    BirdeyeHaryāna, Republic Of India, IN
    Job Title : Data Architect – AI Platform.Department : Engineering / Data Platform.This role is central to building the.You’ll architect and implement the systems that transform raw data into.You won’...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Senior Engineering Manager- Infrastructure AI, Automation & Tools

    Senior Engineering Manager- Infrastructure AI, Automation & Tools

    McCain Foodsharyana, haryana, in
    Sr Engineering Manager – Infrastructure AI, Automation & Tools.Our Global Technology team’s goal is to leverage technology and data to drive profitable growth, focus on enhancing customer experienc...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    Senior Infrastructure Automation Architect

    Senior Infrastructure Automation Architect

    Strategic Talent PartnerHaryāna, Republic Of India, IN
    Terraform, Ansible, Chef, Python / PowerShell, CI / CD (Jenkins / GitLab), Docker, Kubernetes, Azure, VMware, Linux / Windows, Monitoring (Grafana / Splunk). VMware / On-Prem / Hybrid environments.Build and m...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Data & AI Platform Architect

    Data & AI Platform Architect

    BirdeyeHaryāna, Republic Of India, IN
    Job Title : Data Architect – AI Platform.Department : Engineering / Data Platform.This role is central to building the.You’ll architect and implement the systems that transform raw data into.You won’...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    AI Insights Architect

    AI Insights Architect

    BirdeyeHaryāna, Republic Of India, IN
    Job Title : Data Architect – AI Platform.Department : Engineering / Data Platform.This role is central to building the.You’ll architect and implement the systems that transform raw data into.You won’...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    AI Tech Architect

    AI Tech Architect

    Recroharyana, haryana, in
    Own the end-to-end architecture of production AI systems with a strong hands-on bias.You’ll design robust, cost-efficient, and secure agentic / GenAI solutions on AWS. Part of your job will be to unbl...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Sr Architect Automation & DevOps

    Sr Architect Automation & DevOps

    Strategic Talent Partnerharyana, haryana, in
    Terraform, Ansible, Chef, Python / PowerShell, CI / CD (Jenkins / GitLab), Docker, Kubernetes, Azure, VMware, Linux / Windows, Monitoring (Grafana / Splunk). VMware / On-Prem / Hybrid environments.Build and m...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    AI Automation Architect

    AI Automation Architect

    Infinit-OHaryāna, Republic Of India, IN
    This role is deeply technical, requiring hands-on expertise in automation platforms, system integration, and architectural leadership to deliver intelligent, scalable, and future-ready automation f...Show moreLast updated: 13 hours ago