Software Architect (AI Systems)

We are looking for a Senior Software Architect (P5) to lead the design and evolution of scalable, secure, and intelligent AI systems across our enterprise platform. This role requires deep technical expertise in AI / ML system architecture, cloud-native development, and distributed system design, along with the ability to influence cross-functional teams and guide long-term technical direction.

You'll work across engineering, product, data science, and platform teams to architect AI-powered systems-including agentic AI workflows, large language model (LLM) integration, and data orchestration patterns that support operational and user-facing experiences. You will play a critical role in ensuring our AI systems are performant, governable, maintainable, and extensible as they scale across the organization.

Key Responsibilities :

Architect Core AI Infrastructure : Lead the design of modular, extensible AI architectures that support training, inference, data pipelines, and integration with business services.

Agentic AI and Workflow Design : Architect intelligent agent-based systems using frameworks like MCP, LangChain, Semantic Kernel, or custom implementations on orchestration tools like n8n.

Model Integration : Define architecture for integrating LLMs, fine-tuned models, and retrieval-augmented generation (RAG) pipelines into enterprise systems.

System Design Leadership : Deliver high-level architecture and detailed designs for AI solutions that integrate with distributed systems, ensuring scalability, resilience, and observability.

Data-Centric Architecture : Establish robust data architectures for ML pipelines, including feature stores, semantic layers, vector databases, and lineage tracking.

Security & Governance : Partner with security and compliance teams to ensure responsible AI use, model safety, auditability, and adherence to privacy and ethical guidelines.

Technical Strategy : Contribute to long-term architectural vision and standards that accelerate AI adoption across the platform while minimizing duplication and technical debt.

Mentorship & Influence : Serve as a technical leader and mentor for engineers working on AI-related projects, providing architectural guidance and design reviews.

Minimum Qualifications :

10+ years of experience in software architecture and engineering, including significant hands-on development, with at least 3+ years in AI / ML systems or platforms

Proven experience designing large-scale distributed systems and service-oriented architectures

Hands-on experience with AI / ML infrastructure (e.g., Azure ML, Databricks, Vertex AI, SageMaker)

Familiarity with LLMs, vector databases (e.g., Pinecone, Weaviate), and RAG patterns

Proficient in Python and / or TypeScript, with strong design and modeling skills

Experience with infrastructure-as-code and cloud-native platforms (Kubernetes, Terraform, GitHub Actions)

Strong communication skills and ability to articulate architectural trade-offs

Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Preferred Qualifications :

Experience with agentic AI systems, orchestration frameworks like n8n, or bot platforms and frameworks

Knowledge of Model Context Protocol (MCP) or similar metadata-driven AI integration models

Background in security-aware architecture and AI governance frameworks

Experience working in a matrixed or multi-product organization

Track record of driving adoption of architectural patterns or platforms across teams

What You'll Get :

The opportunity to architect the next generation of AI-powered capabilities across an enterprise platform

Deep technical challenges in applied AI, integration, and orchestration

A collaborative environment with high autonomy and visibility

Competitive compensation and advancement opportunities in a high-impact role

Skills Required

Databricks, Typescript, Mcp, Python, Kubernetes, Terraform, Distributed System Design, Azure ML