This job offer is not available in your country.

AI / ML Solution Architect [High Salary]

Fission LabsHyderabad, Telangana, India

8 hours ago

Job description

Role : Solution Architect-AI / ML

Experience : 10+ years

Location : Hyderabad & Pune

Key Responsibilities :

Architecture & Infrastructure

Design, implement, and optimize end-to-end ML training workflows including infrastructure setup, orchestration, fine-tuning, deployment, and monitoring.
Evaluate and integrate multi-cloud and single-cloud training options across AWS and other major platforms.
Lead cluster configuration, orchestration design, environment customization, and scaling strategies.
Compare and recommend hardware options (GPUs, TPUs, accelerators) based on performance, cost, and availability.

Performance & Optimization

Conduct performance benchmarking, hardware comparisons, and cost-performance trade-off analysis.

Implement real-time monitoring and control systems with metrics collection, observability, and custom performance tracking.

Optimize cost models, budget predictability, and resource utilization.

Data & Training Pipelines

Architect and validate data pipelines with storage, persistence, and throughput optimization.

Oversee data quality validation, pre-processing, and long-term experiment tracking.

Support framework flexibility for diverse training techniques (supervised, unsupervised, fine-tuning, reinforcement learning).

Integration & Deployment

Ensure seamless deployment across multi-cloud environments with security, compliance, and regional availability considerations.

Collaborate with DevOps and MLOps teams for automation, fault tolerance, job scheduling, and orchestration testing.

Provide technical guidance on integration with existing enterprise systems.

Analysis & Recommendations

Lead result analysis, insight generation, and actionable recommendations for training performance and user experience improvements.

Present performance claims, benchmarking reports, and speculative decoding insights to stakeholders.

Technical Expertise Requirements

10+ years in architecture roles with at least 5 years in AI / ML infrastructure and large-scale training environments.

Expert in AWS cloud services (EC2, S3, EKS, SageMaker, Batch, FSx, etc.) and familiar with Azure, GCP, and hybrid / multi-cloud setups.

Strong knowledge of AI / ML training frameworks (PyTorch, TensorFlow, Hugging Face, DeepSpeed, Megatron, Ray, etc.).

Proven experience with cluster orchestration tools (Kubernetes, Slurm, Ray, SageMaker, Kubeflow).

Deep understanding of hardware architectures for AI workloads (NVIDIA, AMD, Intel Habana, TPU).

Performance & Cost Management

Demonstrated expertise in performance benchmarking, reliability testing, and training speed optimization.

Skilled in cost modeling, budget forecasting, and cost-performance balancing.

Monitoring & Observability

Experience with real-time monitoring tools (Prometheus, Grafana, CloudWatch) and custom metric instrumentation.

Familiarity with network performance testing, regional load testing, and multi-region deployment strategies.

Soft Skills

Strong problem-solving skills with an analytical mindset.

Excellent communication skills to present technical trade-offs and strategic recommendations to executives and engineering teams.

Ability to lead cross-functional teams and drive innovation in AI infrastructure.

Other Required Skills :

LLM Inference Optimization

Expert knowledge of inference optimization techniques including speculative decoding, KV cache optimization (MQA / GQA / PagedAttention), and dynamic batching.

Deep understanding of prefill vs decode phases, memory-bound vs compute-bound operations.

Experience with quantization methods (INT4 / INT8, GPTQ, AWQ) and model parallelism strategies.

Inference Frameworks

Hands-on experience with production inference engines : vLLM, TensorRT-LLM, DeepSpeed-Inference, or TGI.

Proficiency with serving frameworks : Triton Inference Server, KServe, or Ray Serve.

Familiarity with kernel optimization libraries (FlashAttention, xFormers).

Performance Engineering

Proven ability to optimize inference metrics : TTFT (first token latency), ITL (inter-token latency), and throughput.

Experience profiling and resolving GPU memory bottlenecks and OOM issues.

Knowledge of hardware-specific optimizations for modern GPU architectures (A100 / H100).

System Architecture

Design scalable inference systems meeting strict latency SLAs and throughput requirements.

Implement production patterns for request routing, load balancing, and model versioning.

Balance trade-offs between latency, throughput, cost per token, and model accuracy.

Create a job alert for this search

Solution Architect • Hyderabad, Telangana, India

Related jobs

Promoted

AI / ML Engineer

VeltrisHyderabad, IN

Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 24 days ago

Promoted

AI / ML Engineer

BayRock LabsHyderabad, IN

Role Overview : Build, train, and deploy machine learning models for predictive analytics and data-driven decision making. Implement end-to-end ML pipelines from data preparation to production deplo...Show moreLast updated: 1 day ago

Promoted

AI / ML Solution Architect

Fission LabsHyderabad, Telangana, India

Role : Solution Architect-AI / ML.Design, implement, and optimize end-to-end ML training workflows including infrastructure setup, orchestration, fine-tuning, deployment, and monitoring.Evaluate and i...Show moreLast updated: 6 days ago

Promoted

Gen AI Architect

PepsiCoHyderabad, Telangana, India

The GenAI Technical Solutions Architect develops and implements GEN AI achitecture strategies, best practices, and standards to enhance AI ML model deployment and monitoring efficiency.Develop arch...Show moreLast updated: 13 days ago

AI / ML Engineer - Join our growing community

Xenon7Hyderabad, TS, IN

Quick Apply

Where elite tech talent meets world-class opportunities!.At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies...Show moreLast updated: 30+ days ago

Planview Solution Architect

ProArchHyderabad, TS, IN

Quick Apply

As a Planview Solution Architect at ProArch, you will be instrumental in driving the design and implementation of Planview's solutions to enhance project and portfolio management for our clients.Yo...Show moreLast updated: 14 days ago

Promoted

AI / ML Architect

IGT SolutionsHyderabad, IN

AI / ML Architecture & Development).We are seeking a highly skilled.Generative AI, Agentic AI, and ML frameworks.The ideal candidate will bring extensive experience in architecting enterprise-level s...Show moreLast updated: 24 days ago

Promoted

AI ML Engineer

ExperianHyderabad, Telangana, India

Experian Consumer Services (ECS).AI capabilities that power personalized financial experiences for millions of users.This role is ideal for someone who thrives at the intersection of.ML-driven solu...Show moreLast updated: 20 days ago

Promoted

Generative AI Architect / Lead - LLM

CaptiveAide Advisory Pvt LtdHyderabad

Job Description : We are seeking a highly skilled Generative AI Architect / Lead with 612 years of overall experience and a strong balance of business acumen and tec...Show moreLast updated: 2 days ago

Enterprise Architect (LLMs, GenAI, AI / ML)

NorthBay SolutionsHyderabad, Telangana, IN

Quick Apply

Enterprise Architect (LLMs, GenAI, AI / ML) Experience : 12+ years Location : Abu Dhabi (UAE) About the Role NorthBay Solutions seeks an Enterprise Architect with proven GenAI leadership, strong...Show moreLast updated: 30+ days ago

Promoted

Azure AI Application Architect / MLOps Consultant

MNR SolutionsHyderabad

Key Responsibilities : - Architect and implement intelligent applications using Azure AI services including Azure OpenAI, Azure Cognitive Services, and Azure ...Show moreLast updated: 30+ days ago

Promoted
New!

AI Solutions Architect

Data-Hat AIHyderabad, IN

Chief AI Officer / Lead AI Solutions Architect .International travel required .We are seeking an AI Solutions Architect with over 20 years of experience to serve as a strategic and technical leader...Show moreLast updated: 3 hours ago

Promoted

Senior AI / ML Engineer

Charter GlobalHyderabad, Telangana, India

We are looking for a results-driven.You will be at the forefront of building AI solutions that solve high-value business problems, with full ownership from data preparation to model monitoring.Desi...Show moreLast updated: 1 day ago

Promoted

Senior AI / ML Engineers

Programmers.iohyderabad, telangana, in

In this role, you'll contribute to all phases of the ML lifecycle, from ideation to deployment, and play a key role in delivering high-quality, production-ready applications.Years of work experienc...Show moreLast updated: 13 days ago

Promoted

Kore.ai - Solution Architect - Artificial Intelligence

KORE.AI SOFTWARE INDIA PVT LTDHyderabad

AI transformation, empowering organizations through our comprehensive AI platform portfolio.With innovative offerings across AI for Service, AI for Work, and AI for Process, we enable over 400+ Glo...Show moreLast updated: 30+ days ago

Promoted

Warner Bros. Discovery - Senior Solution Architect - Artificial Intelligence

Warner Bros. DiscoveryHyderabad

Your New Role : The Senior Staff, AI Solutions Architect will occupy a vital position focusing on architecting and realizing value of the c...Show moreLast updated: 30+ days ago

Promoted

Unify Technologies - Senior Engineer / Lead / Architect - Machine Learning / Artificial Intelligence

UNIFY TECHNOLOGIES PVT LTDHyderabad

Job Role / Title : Senior / Lead / Architect SDE-ML / AI Engineer Experience : Senior : 4-15 years Location : Skill : < / ...Show moreLast updated: 30+ days ago

Promoted

Lead AI / ML Engineer

Optum Global Solutions (India) Private LimitedHyderabad

Primary Responsibility : Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but no...Show moreLast updated: 26 days ago

Promoted

Solution Architect - Artificial Intelligence

IMR Soft LLCHyderabad

AISolution Architect : Hyderabad, Hyderabad, Telangana , India (HHTI), Chennai, Chennai, Tamil Nadu, India (TCTI) Experience Range< / b...Show moreLast updated: 30+ days ago

Senior Solution Architect Snowflake AI ( REMOTE Contract )

ADV TECHMINDSHyderabad, Telangana, India

Remote

Quick Apply

We are looking for Senior Solution Architect Snowflake AI.Own the technical vision, integration, and architecture of Snowflake-based AI solutions. Define design and implementation strategies to...Show moreLast updated: 30+ days ago