Talent.com
Ai Tech Architect

Ai Tech Architect

RecroBengaluru, Republic Of India, IN
15 days ago
Job description

AI Tech Architect (7–10 yrs) — Agentic & Gen AI Platforms

Location : Bengaluru / Gurugram

Team : AI Platforms & Architecture

Employment : Full-time

Key Skills : Python, FastAPI, AWS (EKS, Bedrock, OpenSearch, S3, RDS), GenAI & RAG Architecture, Agent Frameworks (Semantic Kernel, LangGraph, AutoGen), Vector Databases, Observability (OpenTelemetry, Datadog), Security & Scalability Design.

Overview

Own the end-to-end architecture of production AI systems with a strong hands-on bias. You’ll design robust, cost-efficient, and secure agentic / GenAI solutions on AWS. Part of your job will be to unblock lead developers by debugging code, optimizing performance, and guiding best practices. Expect to turn complex requirements into scalable, observable, and well-governed platforms.

Responsibilities

  • Define target architectures for agentic systems (planning / reasoning / tool-calling), GenAI / RAG pipelines, and evaluation loops;

produce clear design documents with Flow / UML / sequence diagrams and AWS deployment topologies.

  • Size and optimize infrastructure for cost and performance : model throughput / latency, concurrency, autoscaling policies, CPU / GPU needs, memory footprints, vector index sizing, storage / egress, and token budgets.
  • Lead deep-dive debugging and incident resolution : profile bottlenecks, fix defects, stabilize services;
  • pair-program with developers to raise the engineering bar.

  • Establish reference implementations for multi-agent frameworks (Semantic Kernel preferred;
  • LangGraph / AutoGen / CrewAI acceptable), tool / function schemas, validation, memory, grounding, and multi-step planning.

  • Architect retrieval and hybrid search systems : ingestion, chunking, embeddings, ranking, caching, freshness, and grounding;
  • evaluate recall, precision, and hallucination risk.

  • Productionize on AWS using Amazon EKS, S3, SQS / SNS, and AWS Bedrock;
  • integrate identity (Okta / IAM), secrets (AWS Secrets Manager), eventing, and observability;
  • enforce SLIs / SLOs and error budgets.

  • Make systems observable : distributed tracing, metrics, and logs using OpenTelemetry and Datadog;
  • standardize dashboards,alerts, and tool / trace replay.

  • Build evaluation and promotion workflows : prompt / flow tests, golden sets, offline batch runs, A / B experiments, regression suites, and rollout gates.
  • Design security and safety controls : threat modeling, prompt-injection defense, sandboxed tools, policy enforcement, red-team testing, PII / data governance, and audit trails.
  • Define platform standards : reusable SDKs, connectors, CI / CD templates, runbooks, and architecture review checklists.
  • Partner with product, data, and SRE teams to plan capacity, disaster recovery, multi-region posture, and upgrade paths;
  • lead readiness reviews and post-incident RCAs.

  • Mentor engineers and review PRs with a focus on reliability, correctness, and maintainability.
  • Must Have

  • 7–10 years in software / AI engineering with at least 4+ years building GenAI applications and 2+ years architecting production agentic systems.
  • Strong hands-on expertise in Python 3.11+ (typing, asyncio, packaging, profiling, pytest);
  • able to dive into code,fix bugs, and optimize performance-critical paths.

  • Experience with one or more agent frameworks (Semantic Kernel, LangGraph, AutoGen, CrewAI) and function / tool calling with schema and argument validation.
  • Proven design of GenAI / RAG / hybrid retrieval systems using AWS Bedrock, OpenSearch Serverless, or other vector databases;
  • grounding and retrievalevaluation experience.

  • Deep knowledge of AWS architecture : Amazon EKS, Bedrock, S3, SQS / SNS, RDS (SQL Server / PostgreSQL), ElastiCache (Redis), Secrets Manager, IAM / Okta, Kong API Gateway, OpenSearch Serverless, and Datadog.
  • Observability expertise : distributed tracing (OpenTelemetry), metrics, logs, correlation IDs, and service-level objectives;
  • mature incident response and on-call practices.

  • Cost and performance engineering mindset : capacity modeling, GPU / CPU sizing, autoscaling (HPA), batching / streaming, caching, and FinOps discipline.
  • Security and safety fundamentals : least privilege, data isolation, policy enforcement, content moderation, jailbreak / PII defenses, and compliance awareness.
  • Excellent technical communication : clear diagrams, ADRs, design docs;
  • empathetic, structured code and architecture reviews.

    Good to Have

  • Multi-agent orchestration patterns : task decomposition, coordinator-worker, human-in-the-loop, graph-based planning.
  • Deep expertise with vector databases and retrieval : OpenSearch Serverless, Pinecone, pgvector, Redis.
  • Evaluation frameworks : red teaming, automated guardrails, regression testing, rollout gates, canary deployments.
  • Frontend integration for agent UIs (streaming responses, tool traces), secure connector APIs, and AuthN / Z best practices.
  • Policy-as-code (OPA) and multi-tenant architecture (RBAC, quotas, usage metering).
  • Knowledge of Kong API Gateway, LaunchDarkly / Flipt for feature management, and NeMo Guardrails for runtime safety.
  • CI / CD exposure (build / test with GitHub Actions, deployments via Terraform / AWS IaC templates).
  • Core Tech Stack (our core;
  • equivalents welcome)

  • Python 3.11+, FastAPI, Pydantic v2, SQLAlchemy 2.X, Alembic, pytest.
  • Amazon EKS, AWS Bedrock, Amazon SQS / SNS, Amazon RDS (SQL Server / PostgreSQL), ElastiCache (Redis).
  • Amazon S3 for storage, Amazon ECR for container images, OpenSearch Serverless for vector storage.
  • AWS Secrets Manager, Okta IAM, NeMo Guardrails, Kong API Gateway.
  • OpenTelemetry + Datadog for observability and monitoring.
  • Custom RAG Services, Bedrock Knowledge Base, and LLM evaluation with Phoenix, Arize, and Promptfoo.
  • Create a job alert for this search

    Ai Architect • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    AI Architect

    AI Architect

    AscendionBengaluru, Karnataka, India
    Floor, Prestige Blue Chip Software Park Tower-1, PRESTIGE BLUE CHIP SOFTWARE PARK, Marigowda Rd, Dairy Colony, Adugodi, Bengaluru, Karnataka 560029. Own the technical direction, solution integrity, ...Show moreLast updated: 30+ days ago
    • Promoted
    AI Architect

    AI Architect

    ConcentrixBengaluru, Karnataka, India
    JOB DESCRITION EXP-5 to 8 years NP-Immediate Joiners Secure AI Architect Top Skills : - Cloud Security Architecture (Microsoft Ecosystem) - Deep expertise in Purview, Entra ID, Defender for Clo...Show moreLast updated: 26 days ago
    • Promoted
    Architect - AI Platforms

    Architect - AI Platforms

    WayfairBengaluru, Karnataka, India
    We are looking for an experienced architect to join our AI Platforms team that is building Wayfair's cutting edge solutions to the complex challenges teams encounter when developing AI applications...Show moreLast updated: 30+ days ago
    • Promoted
    Agentic Architect

    Agentic Architect

    RecroBengaluru, India
    AI Tech Architect (7–10 yrs) — Agentic & Gen AI Platforms.Location : Bengaluru / Gurugram.Team : AI Platforms & Architecture. Key Skills : Python, FastAPI, AWS (EKS, Bedrock, OpenSearch, S3, RDS), GenA...Show moreLast updated: 9 days ago
    • Promoted
    Generative AI Architect

    Generative AI Architect

    Sonata SoftwareBengaluru, India
    In today's market, there is a unique duality in technology adoption.On one side, extreme focus on cost containment by clients, and on the other, deep motivation to modernize their Digital storefron...Show moreLast updated: 16 days ago
    • Promoted
    AI Architect

    AI Architect

    RecroBengaluru, Karnataka, India
    This is a highly hands-on role requiring deep architectural insight, coding proficiency, and an obsession with performance, scalability, and reliability. You’ll architect secure, cost-efficient AI p...Show moreLast updated: 30+ days ago
    • Promoted
    AI Architect

    AI Architect

    Black BoxBengaluru, Karnataka, India
    In a technical services company that builds leveraged.The Senior Innovation Architect ensures all innovative solutions align with the client’s security requirements and enterprise architecture stan...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Agentic AI Architect

    Agentic AI Architect

    Infinit-OBangalore, IN
    This role is deeply technical, requiring hands-on expertise in automation platforms, system integration, and architectural leadership to deliver intelligent, scalable, and future-ready automation f...Show moreLast updated: 17 hours ago
    • Promoted
    • New!
    GenAI Architect

    GenAI Architect

    Career Soft Solutions Pvt. Ltd.bangalore, karnataka, in
    Bangalore / Hyderabad / Chennai / Pune / Mumbai / NCR / Kolkata / Bhubaneswar / Ahmedabad / Cochin.Experience in designing and implementing Generative AI systems and solutions with understanding of ...Show moreLast updated: 19 hours ago
    • Promoted
    AI Tech Architect

    AI Tech Architect

    RecroBengaluru, Karnataka, India
    Own the end-to-end architecture of production AI systems with a strong hands-on bias.You’ll design robust, cost-efficient, and secure agentic / GenAI solutions on AWS. Part of your job will be to unbl...Show moreLast updated: 15 days ago
    • Promoted
    Generative AI Architect

    Generative AI Architect

    ITC InfotechBengaluru, Karnataka, India
    Hi, We have the following role open in Bangalore, Interested candidates can send their detailed profile to manikandan.Current CTC, Expected CTC and Notice period to join. We are seeking a visionary ...Show moreLast updated: 13 days ago
    • Promoted
    Gen AI Architect

    Gen AI Architect

    Sonata SoftwareBengaluru, Karnataka, India
    We are looking for Gen AI Architect.Gen AI Architect with experience in.Net, LLM, Langchain, Agentic AI, Azure Open AI, Azure functions, Azure DevOps and deployment experience.Show moreLast updated: 1 day ago
    • Promoted
    AI Architect

    AI Architect

    CirrusLabsBengaluru, India
    Job Location : Bangalore (Hybrid).Mandatory skills : Python, Gen AI, traditional ML, core Data scientist, ML Ops, Agentic AI. We are seeking an experienced AI Architect to join our dynamic team.This ...Show moreLast updated: 30+ days ago
    • Promoted
    AI Architect

    AI Architect

    GreenTree Advisory Services Pvt LtdBengaluru, Karnataka, India
    AVP – AI Engineer / Data Scientist.Bangalore / Pune / Gurgaon / Noida.The role involves leading AI and data science initiatives, with responsibility for designing and implementing scalable AI solut...Show moreLast updated: 7 days ago
    • Promoted
    Generative AI Architect

    Generative AI Architect

    Leading Healthcare IndustryBengaluru, Karnataka, India
    We are seeking a highly skilled and experienced.This role goes beyond building AI models—it involves architecting robust, scalable, and secure AI-powered applications and services across the full t...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    AIML Architect

    AIML Architect

    ValueLabshosur, tamil nadu, in
    We at ValueLabs have an Opening for AI / ML Architect role.At least 7+ years of relevant AI / ML experience or previous ML experience with strong engineering competencies and at least 2+ years in Gener...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Technical Architect

    Technical Architect

    VARITE INChosur, tamil nadu, in
    UI development, with at least 4+ years in Flutter & hybrid app development.Expertise in Flutter framework, Dart programming, and cross-platform UI architecture. Strong knowledge of state management ...Show moreLast updated: 10 hours ago
    • Promoted
    AI Architect

    AI Architect

    EvoluteIQhosur, tamil nadu, in
    We at EvoluteIQ believe in the power of transformation.We are committed to building an industry leading technology that will revolutionize the way enterprises conduct business.To make that happen, ...Show moreLast updated: 8 days ago