AI Architect

AI Architect

Role Summary

The AI Architect is responsible for designing the end-to-end architecture, frameworks that enable scalable, and high-performance AI systems both within the organization and for product teams. This role bridges machine learning, software engineering, and cloud infrastructure to create a cohesive enterprise AI ecosystem. The AI Architect defines reference architectures, accelerates solution teams, ensures compliance, and sets the technical direction for how AI is built, deployed, and governed.

Key Responsibilities

• Design the AI architecture for the enterprise including inference layers, vector stores, data ingestion, orchestration, and monitoring.
• Architect scalable LLM / RAG systems, agent frameworks, and generative AI services that can be reused across domains and business units.
• Define standards for embeddings, vectorization, prompt orchestration, caching layers, and evaluation pipelines.
• Establish patterns for developing, fine-tuning, and deploying ML / LLM models
• Evaluate when to use foundation models, when to fine-tune, and when to build custom models.
• Define and enforce AI architecture principles, security policies, and compliance (HIPAA, FDA, ISO).
• Implement guardrails for privacy, PHI / PII protection, safe model usage, hallucination risk mitigation, audit logging, and explainability.
• Partner with data engineering, IT security, cloud infrastructure, and product teams to ensure architectural alignment.
• Participate in roadmap planning and technology selection for the AI / ML ecosystem.
• Conduct build-vs-buy assessments for AI platforms, tokenization, data protection, vector databases, model hosting, and MLOps tools.

Required Qualifications

Preferred Qualifications