Talent.com
No longer accepting applications
Ai Tech Architect

Ai Tech Architect

RecroRājahmundry, Republic Of India, IN
1 day ago
Job description

AI Tech Architect (7–10 yrs) — Agentic & Gen AI Platforms

Location : Bengaluru / Gurugram

Team : AI Platforms & Architecture

Employment : Full-time

Key Skills : Python, FastAPI, AWS (EKS, Bedrock, OpenSearch, S3, RDS), GenAI & RAG Architecture, Agent Frameworks (Semantic Kernel, LangGraph, AutoGen), Vector Databases, Observability (OpenTelemetry, Datadog), Security & Scalability Design.

Overview

Own the end-to-end architecture of production AI systems with a strong hands-on bias. You’ll design robust, cost-efficient, and secure agentic / GenAI solutions on AWS. Part of your job will be to unblock lead developers by debugging code, optimizing performance, and guiding best practices. Expect to turn complex requirements into scalable, observable, and well-governed platforms.

Responsibilities

  • Define target architectures for agentic systems (planning / reasoning / tool-calling), GenAI / RAG pipelines, and evaluation loops;

produce clear design documents with Flow / UML / sequence diagrams and AWS deployment topologies.

  • Size and optimize infrastructure for cost and performance : model throughput / latency, concurrency, autoscaling policies, CPU / GPU needs, memory footprints, vector index sizing, storage / egress, and token budgets.
  • Lead deep-dive debugging and incident resolution : profile bottlenecks, fix defects, stabilize services;
  • pair-program with developers to raise the engineering bar.

  • Establish reference implementations for multi-agent frameworks (Semantic Kernel preferred;
  • LangGraph / AutoGen / CrewAI acceptable), tool / function schemas, validation, memory, grounding, and multi-step planning.

  • Architect retrieval and hybrid search systems : ingestion, chunking, embeddings, ranking, caching, freshness, and grounding;
  • evaluate recall, precision, and hallucination risk.

  • Productionize on AWS using Amazon EKS, S3, SQS / SNS, and AWS Bedrock;
  • integrate identity (Okta / IAM), secrets (AWS Secrets Manager), eventing, and observability;
  • enforce SLIs / SLOs and error budgets.

  • Make systems observable : distributed tracing, metrics, and logs using OpenTelemetry and Datadog;
  • standardize dashboards,alerts, and tool / trace replay.

  • Build evaluation and promotion workflows : prompt / flow tests, golden sets, offline batch runs, A / B experiments, regression suites, and rollout gates.
  • Design security and safety controls : threat modeling, prompt-injection defense, sandboxed tools, policy enforcement, red-team testing, PII / data governance, and audit trails.
  • Define platform standards : reusable SDKs, connectors, CI / CD templates, runbooks, and architecture review checklists.
  • Partner with product, data, and SRE teams to plan capacity, disaster recovery, multi-region posture, and upgrade paths;
  • lead readiness reviews and post-incident RCAs.

  • Mentor engineers and review PRs with a focus on reliability, correctness, and maintainability.
  • Must Have

  • 7–10 years in software / AI engineering with at least 4+ years building GenAI applications and 2+ years architecting production agentic systems.
  • Strong hands-on expertise in Python 3.11+ (typing, asyncio, packaging, profiling, pytest);
  • able to dive into code,fix bugs, and optimize performance-critical paths.

  • Experience with one or more agent frameworks (Semantic Kernel, LangGraph, AutoGen, CrewAI) and function / tool calling with schema and argument validation.
  • Proven design of GenAI / RAG / hybrid retrieval systems using AWS Bedrock, OpenSearch Serverless, or other vector databases;
  • grounding and retrievalevaluation experience.

  • Deep knowledge of AWS architecture : Amazon EKS, Bedrock, S3, SQS / SNS, RDS (SQL Server / PostgreSQL), ElastiCache (Redis), Secrets Manager, IAM / Okta, Kong API Gateway, OpenSearch Serverless, and Datadog.
  • Observability expertise : distributed tracing (OpenTelemetry), metrics, logs, correlation IDs, and service-level objectives;
  • mature incident response and on-call practices.

  • Cost and performance engineering mindset : capacity modeling, GPU / CPU sizing, autoscaling (HPA), batching / streaming, caching, and FinOps discipline.
  • Security and safety fundamentals : least privilege, data isolation, policy enforcement, content moderation, jailbreak / PII defenses, and compliance awareness.
  • Excellent technical communication : clear diagrams, ADRs, design docs;
  • empathetic, structured code and architecture reviews.

    Good to Have

  • Multi-agent orchestration patterns : task decomposition, coordinator-worker, human-in-the-loop, graph-based planning.
  • Deep expertise with vector databases and retrieval : OpenSearch Serverless, Pinecone, pgvector, Redis.
  • Evaluation frameworks : red teaming, automated guardrails, regression testing, rollout gates, canary deployments.
  • Frontend integration for agent UIs (streaming responses, tool traces), secure connector APIs, and AuthN / Z best practices.
  • Policy-as-code (OPA) and multi-tenant architecture (RBAC, quotas, usage metering).
  • Knowledge of Kong API Gateway, LaunchDarkly / Flipt for feature management, and NeMo Guardrails for runtime safety.
  • CI / CD exposure (build / test with GitHub Actions, deployments via Terraform / AWS IaC templates).
  • Core Tech Stack (our core;
  • equivalents welcome)

  • Python 3.11+, FastAPI, Pydantic v2, SQLAlchemy 2.X, Alembic, pytest.
  • Amazon EKS, AWS Bedrock, Amazon SQS / SNS, Amazon RDS (SQL Server / PostgreSQL), ElastiCache (Redis).
  • Amazon S3 for storage, Amazon ECR for container images, OpenSearch Serverless for vector storage.
  • AWS Secrets Manager, Okta IAM, NeMo Guardrails, Kong API Gateway.
  • OpenTelemetry + Datadog for observability and monitoring.
  • Custom RAG Services, Bedrock Knowledge Base, and LLM evaluation with Phoenix, Arize, and Promptfoo.
  • Create a job alert for this search

    Ai Architect • Rājahmundry, Republic Of India, IN

    Related jobs
    • Promoted
    Technical Architect Team Lead

    Technical Architect Team Lead

    QNOPY Inc.rajahmundry, andhra pradesh, in
    We are seeking an experienced Technical Team Lead with a strong background in delivering SaaS products to lead our engineering team. The ideal candidate has 7+ years of hands-on experience in softwa...Show moreLast updated: 10 days ago
    • Promoted
    Technical Architect Oracle Cloud

    Technical Architect Oracle Cloud

    Proso.airajahmundry, andhra pradesh, in
    Technical Architect – Oracle Fusion Cloud (OIC, VBCS, OCI, ERP, HCM).We are seeking a highly experienced.Oracle Fusion Cloud Technical Architect. Oracle Integration Cloud (OIC).Visual Builder Cloud ...Show moreLast updated: 2 days ago
    • Promoted
    GenAI Architect

    GenAI Architect

    Trantorrajahmundry, India
    Minimum Qualifications / Skills : .Bachelor’s or Master’s degree in computer science, AI, Machine Learning, Data Science, or a. AI / ML, particularly with generative AI models.Strong expertise in develo...Show moreLast updated: 14 days ago
    • Promoted
    Director - Ai Architect

    Director - Ai Architect

    Live ConnectionsRājahmundry, Republic Of India, IN
    Role : Director Principle Technology Architect.Budget : 55 lpa includes 10% var.Finding strong AI Architect profiles with a solid background in Design & development. Design and Oversee AI Architecture...Show moreLast updated: 2 days ago
    • Promoted
    Gen Ai Architect

    Gen Ai Architect

    IGT SolutionsRājahmundry, Republic Of India, IN
    Job Title : Architect - Gen AI, LLM, Big Data.We are looking for an experienced Architect with deep expertise in Generative AI (Gen AI), Large Language Models (LLM), and Big Data technologies.The id...Show moreLast updated: 2 days ago
    • Promoted
    Ai / Ml Solutions Architect_consulting

    Ai / Ml Solutions Architect_consulting

    HireginieRājahmundry, Republic Of India, IN
    A leading IT and data solutions provider offering services in consulting, systems integration, data science, IoT, and business process outsourcing. The company enables organizations to enhance effic...Show moreLast updated: 2 days ago
    • Promoted
    Senior Test Engineer - III

    Senior Test Engineer - III

    ConfidentialBhimavaram, India
    With the introduction of 5G and cloud, the role of IT Managed Services has evolved to become an enabler of new revenue opportunities, in addition to delivering efficient cloud and IT operations for...Show moreLast updated: 1 day ago
    • Promoted
    AI Architect

    AI Architect

    Persistent Systemsrajahmundry, andhra pradesh, in
    We are seeking a highly skilled and innovative Agentic AI Developer to architect and implement intelligent, autonomous AI workflows and backend systems. This role is ideal for someone passionate abo...Show moreLast updated: 16 days ago
    • Promoted
    AI / ML Solutions Architect_Consulting

    AI / ML Solutions Architect_Consulting

    HireginieRajahmundry, IN
    A leading IT and data solutions provider offering services in consulting, systems integration, data science, IoT, and business process outsourcing. The company enables organizations to enhance effic...Show moreLast updated: 2 days ago
    • Promoted
    Technical Architect

    Technical Architect

    ValueLabsrajahmundry, andhra pradesh, in
    We are seeking a seasoned GCP Data Warehouse Architect to lead the design, development, and governance of scalable, secure, and high-performance data architectures on Google Cloud Platform (GCP).Th...Show moreLast updated: 1 day ago
    • Promoted
    AI Data Architect

    AI Data Architect

    Tata Consultancy ServicesRajahmundry, Andhra Pradesh, India
    Role : - AI Data Architect Experience- 8 to 15years Location - PAN India Job Description We are seeking an inventive Data Architect for AI with 8–15 years of experience to lead the strategic design ...Show moreLast updated: 18 days ago
    • Promoted
    Gen AI Architect

    Gen AI Architect

    IGT SolutionsRajahmundry, IN
    Job Title : Architect - Gen AI, LLM, Big Data.We are looking for an experienced Architect with deep expertise in Generative AI (Gen AI), Large Language Models (LLM), and Big Data technologies.The id...Show moreLast updated: 2 days ago
    • Promoted
    Full Stack Architect / Lead Engineer / AI solution-building

    Full Stack Architect / Lead Engineer / AI solution-building

    Prowessoft IncRajahmundry, IN
    We are looking for a Full Stack Architect / Lead Engineer with strong hands-on coding and AI solution-building expertise. You will design, build, and scale modern cloud-native applications — leading...Show moreLast updated: 2 days ago
    • Promoted
    AI Architect

    AI Architect

    Tata Consultancy Servicesrajahmundry, andhra pradesh, in
    We are seeking a visionary AI Architect with 8 –15 years of overall experience to lead the strategic design and implementation of enterprise-scale AI solutions. This role requires deep expertise in ...Show moreLast updated: 22 days ago
    • Promoted
    Director - AI Architect

    Director - AI Architect

    Live ConnectionsRajahmundry, Andhra Pradesh, India
    Role : Director Principle Technology Architect Experience : 15+ yrs Work Mode : Remote Budget : 55 lpa includes 10% var • •Finding strong AI Architect profiles with a solid background in Design & devel...Show moreLast updated: 30+ days ago
    • Promoted
    Gen AI Architect / Lead

    Gen AI Architect / Lead

    Sonata Softwarerajahmundry, andhra pradesh, in
    We’re Hiring : GenAI Lead | Microsoft Azure.AI, cloud-native development, and Azure ecosystem mastery.Hiring #GenAI #Azure #AIJobs #CloudComputing #TechLeadership #MicrosoftAzure #AIInnovation.Show moreLast updated: 23 days ago
    • Promoted
    Ai Architect With Azure

    Ai Architect With Azure

    Sonata SoftwareRājahmundry, Republic Of India, IN
    We are looking for an Architect with expertise in Generative AI and Microsoft Azure.Architect, design, and deliver GenAI-enabled solutions on Microsoft Azure. Develop cloud-native applications using...Show moreLast updated: 17 days ago
    • Promoted
    AI Architect with Azure

    AI Architect with Azure

    Sonata Softwarerajahmundry, andhra pradesh, in
    We are looking for an Architect with expertise in Generative AI and Microsoft Azure.Architect, design, and deliver GenAI-enabled solutions on Microsoft Azure. Develop cloud-native applications using...Show moreLast updated: 23 days ago