Talent.com
Ai Tech Architect
Ai Tech ArchitectRecro • Karnal, Haryana, India
Ai Tech Architect

Ai Tech Architect

Recro • Karnal, Haryana, India
1 day ago
Job description

Overview Own the end-to-end architecture of production AI systems with a strong hands-on bias. You’ll design robust, cost-efficient, and secure agentic / GenAI solutions on AWS. Part of your job will be to unblock lead developers by debugging code, optimizing performance, and guiding best practices. Expect to turn complex requirements into scalable, observable, and well-governed platforms.

Responsibilities

  • Define target architectures for agentic systems (planning / reasoning / tool-calling), GenAI / RAG pipelines, and evaluation loops;

produce clear design documents with Flow / UML / sequence diagrams and AWS deployment topologies.

  • Size and optimize infrastructure for cost and performance : model throughput / latency, concurrency, autoscaling policies, CPU / GPU needs, memory footprints, vector index sizing, storage / egress, and token budgets.
  • Lead deep-dive debugging and incident resolution : profile bottlenecks, fix defects, stabilize services;
  • pair-program with developers to raise the engineering bar.

  • Establish reference implementations for multi-agent frameworks (Semantic Kernel preferred;
  • LangGraph / AutoGen / CrewAI acceptable), tool / function schemas, validation, memory, grounding, and multi-step planning.

  • Architect retrieval and hybrid search systems : ingestion, chunking, embeddings, ranking, caching, freshness, and grounding;
  • evaluate recall, precision, and hallucination risk.

  • Productionize on AWS using Amazon EKS, S3, SQS / SNS, and AWS Bedrock;
  • integrate identity (Okta / IAM), secrets (AWS Secrets Manager), eventing, and observability;
  • enforce SLIs / SLOs and error budgets.

  • Make systems observable : distributed tracing, metrics, and logs using OpenTelemetry and Datadog;
  • standardize dashboards,alerts, and tool / trace replay.

  • Build evaluation and promotion workflows : prompt / flow tests, golden sets, offline batch runs, A / B experiments, regression suites, and rollout gates.
  • Design security and safety controls : threat modeling, prompt-injection defense, sandboxed tools, policy enforcement, red-team testing, PII / data governance, and audit trails.
  • Define platform standards : reusable SDKs, connectors, CI / CD templates, runbooks, and architecture review checklists.
  • Partner with product, data, and SRE teams to plan capacity, disaster recovery, multi-region posture, and upgrade paths;
  • lead readiness reviews and post-incident RCAs.

  • Mentor engineers and review PRs with a focus on reliability, correctness, and maintainability.
  • Must Have

  • 7–10 years in software / AI engineering with at least 4+ years building GenAI applications and 2+ years architecting production agentic systems.
  • Strong hands-on expertise in Python 3.11+ (typing, asyncio, packaging, profiling, pytest);
  • able to dive into code,fix bugs, and optimize performance-critical paths.

  • Experience with one or more agent frameworks (Semantic Kernel, LangGraph, AutoGen, CrewAI) and function / tool calling with schema and argument validation.
  • Proven design of GenAI / RAG / hybrid retrieval systems using AWS Bedrock, OpenSearch Serverless, or other vector databases;
  • grounding and retrievalevaluation experience.

  • Deep knowledge of AWS architecture : Amazon EKS, Bedrock, S3, SQS / SNS, RDS (SQL Server / PostgreSQL), ElastiCache (Redis), Secrets Manager, IAM / Okta, Kong API Gateway, OpenSearch Serverless, and Datadog.
  • Observability expertise : distributed tracing (OpenTelemetry), metrics, logs, correlation IDs, and service-level objectives;
  • mature incident response and on-call practices.

  • Cost and performance engineering mindset : capacity modeling, GPU / CPU sizing, autoscaling (HPA), batching / streaming, caching, and FinOps discipline.
  • Security and safety fundamentals : least privilege, data isolation, policy enforcement, content moderation, jailbreak / PII defenses, and compliance awareness.
  • Excellent technical communication : clear diagrams, ADRs, design docs;
  • empathetic, structured code and architecture reviews.

    Good to Have

  • Multi-agent orchestration patterns : task decomposition, coordinator-worker, human-in-the-loop, graph-based planning.
  • Deep expertise with vector databases and retrieval : OpenSearch Serverless, Pinecone, pgvector, Redis.
  • Evaluation frameworks : red teaming, automated guardrails, regression testing, rollout gates, canary deployments.
  • Frontend integration for agent UIs (streaming responses, tool traces), secure connector APIs, and AuthN / Z best practices.
  • Policy-as-code (OPA) and multi-tenant architecture (RBAC, quotas, usage metering).
  • Knowledge of Kong API Gateway, LaunchDarkly / Flipt for feature management, and NeMo Guardrails for runtime safety.
  • CI / CD exposure (build / test with GitHub Actions, deployments via Terraform / AWS IaC templates).
  • Core Tech Stack (our core;
  • equivalents welcome)

  • Python 3.11+, FastAPI, Pydantic v2, SQLAlchemy 2.X, Alembic, pytest.
  • Amazon EKS, AWS Bedrock, Amazon SQS / SNS, Amazon RDS (SQL Server / PostgreSQL), ElastiCache (Redis).
  • Amazon S3 for storage, Amazon ECR for container images, OpenSearch Serverless for vector storage.
  • AWS Secrets Manager, Okta IAM, NeMo Guardrails, Kong API Gateway.
  • OpenTelemetry + Datadog for observability and monitoring.
  • Custom RAG Services, Bedrock Knowledge Base, and LLM evaluation with Phoenix, Arize, and Promptfoo.
  • Create a job alert for this search

    Ai Architect • Karnal, Haryana, India

    Related jobs
    Agentic Ai Architect

    Agentic Ai Architect

    Infinit-O • Karnal, Haryana, India
    Role Overview : This role is deeply technical, requiring hands-on expertise in automation platforms, system integration, and architectural leadership to deliver intelligent, scalable, and future-...Show more
    Last updated: 1 day ago • Promoted
    Generative Ai Engineer

    Generative Ai Engineer

    Recro • Karnal, Haryana, India
    About the job Role Overview As the AI Systems Architect , you’ll own the end-to-end design and delivery of production-grade agentic and Generative AI systems. This is a highly hands-on role requ...Show more
    Last updated: 1 day ago • Promoted
    Gen Ai Architect - Immediate Joiners (Bengaluru, Chennai, Gurgaon & Pune)

    Gen Ai Architect - Immediate Joiners (Bengaluru, Chennai, Gurgaon & Pune)

    Xebia • Karnal, Haryana, India
    About Xebia Xebia is a trusted advisor in the modern era of digital transformation, serving hundreds of leading brands worldwide with end-to-end IT solutions. The company has experts specializin...Show more
    Last updated: 1 day ago • Promoted
    Ai Engineer

    Ai Engineer

    empirical.run • Karnal, Haryana, India
    At Empirical, we build AI agents that write and maintain e2e tests for web apps.Our agents ship thousands of test changes daily, by replicating actions that QA engineers take : editing test code fil...Show more
    Last updated: 1 day ago • Promoted
    Ai Architect

    Ai Architect

    KPMG India • Karnal, Haryana, India
    About us KPMG Delivery Network India (KDNI) is a diverse entity spread across multiple cities in India.We are an important part of the KPMG Delivery Network (KDN), a global organization that sup...Show more
    Last updated: 1 day ago • Promoted
    Interior Design Faculty

    Interior Design Faculty

    Budha College • Karnal, Haryana, India
    Job Title : Interior Design Faculty.Budha College, Karnal, Haryana.Please include your portfolio, Instagram / design page, or sample work links if available. We’re building a new-age Interior Design pr...Show more
    Last updated: 5 days ago • Promoted
    Enterprise Architect

    Enterprise Architect

    airtel • Karnal, Haryana, India
    About the Role : We are launching a new NBFC and are seeking a seasoned Enterprise Architect to drive our technology blueprint and ensure seamless alignment between business vision and IT strateg...Show more
    Last updated: 1 day ago • Promoted
    Lead Cloud Architect

    Lead Cloud Architect

    Oracle • Karnal, Haryana, India
    Job Description : Lead Cloud Architect – Multicloud Role Summary : We are seeking a visionary and hands-on Lead Cloud Architect to lead end-to-end architecture, solution development, innovation, and...Show more
    Last updated: 1 day ago • Promoted
    Project Architect

    Project Architect

    EMRIOM SOLUTIONS • Karnal, Haryana, India
    Objectives of the Job Handle projects independently, under guidance of Head Designs / Sr Architect.To be solely responsible for Project planning, coordination, line up, material procurement, projec...Show more
    Last updated: 1 day ago • Promoted
    Sr Architect Automation & Devops

    Sr Architect Automation & Devops

    Strategic Talent Partner • Karnal, Haryana, India
    DevOps Architect to lead infrastructure automation across hybrid and on-prem environments.Key Skills : Terraform, Ansible, Chef, Python / PowerShell, CI / CD (Jenkins / GitLab), Docker, Kubernetes, Az...Show more
    Last updated: 1 day ago • Promoted
    Manager Ai

    Manager Ai

    Birdeye • Karnal, Haryana, India
    Manager- AI Why Birdeye? Birdeye is the highest-rated reputation, social media, and customer experience platform for local businesses and brands. Over 150,000 businesses use Birdeye’s AI-powered pla...Show more
    Last updated: 1 day ago • Promoted
    Github Architect

    Github Architect

    Stratacent • Karnal, Haryana, India
    Job Title : GitHub Architect Location : Pune / Gurugram Experience : 10+ Years Shift Timing : 2-11 PM / 3 PM – 12 AM IST Job Summary : The GitHub Architect will be responsible for designing, i...Show more
    Last updated: 1 day ago • Promoted
    Senior Architect, Generative Ai And Ai Agent Factory

    Senior Architect, Generative Ai And Ai Agent Factory

    PepsiCo • Karnal, Haryana, India
    Overview The Senior Technical Architect – Generative AI and Agent Factory is responsible for leading the end-to-end architecture, design, and strategic enablement of PepsiCo's enterprise-grade G...Show more
    Last updated: 1 day ago • Promoted
    Lead Applied Ai Engineer

    Lead Applied Ai Engineer

    Taggd • Karnal, Haryana, India
    Why this role We’re building agentic AI for recruitment workflows—sourcing, screening, interview assistance, and offer orchestration. You’ll own LLM / agent design, retrieval, evaluation, safety, an...Show more
    Last updated: 1 day ago • Promoted
    Data Architect - Ai Platform

    Data Architect - Ai Platform

    Birdeye • Karnal, Haryana, India
    Job Title : Data Architect – AI Platform Location : Hybrid Department : Engineering / Data Platform About the Role We’re looking for a self-motivated, hands-on Data Architect with a deep backg...Show more
    Last updated: 1 day ago • Promoted
    Ai Engineer

    Ai Engineer

    Recro • Karnal, Haryana, India
    What you’ll work on : - Designing & deploying agentic workflows (Semantic Kernel / LangGraph / AutoGen / CrewAI) - Building tool-calling flows, RAG pipelines, and hybrid search - Deploying AI agen...Show more
    Last updated: 30+ days ago • Promoted
    Ai Engineer

    Ai Engineer

    KPMG Delivery Network • Karnal, Haryana, India
    About us KPMG Delivery Network India (KDNI) is a diverse entity spread across multiple cities in India.We are an important part of the KPMG Delivery Network (KDN), a global organization that suppor...Show more
    Last updated: 1 day ago • Promoted
    Technical Architect(Frontend)

    Technical Architect(Frontend)

    dunnhumby • Karnal, Haryana, India
    This is a hands-on architecture role.You will design and build working solutions, not just write architecture papers.You will define patterns, produce reference implementations, and partner closely...Show more
    Last updated: 1 day ago • Promoted