Principal Engineer, Software - AIOps [T500-20350]

About T-Mobile :

T-Mobile US, Inc. (NASDAQ : TMUS), headquartered in Bellevue, Washington, is America’s supercharged Un-carrier, connecting millions through its strong nationwide network and flagship brands, T-Mobile and Metro by T-Mobile. Customers benefit from an unmatched combination of value, quality, and exceptional service experience.

TMUS Global Solutions :

TMUS Global Solutions is a world-class technology powerhouse accelerating the company’s global digital transformation. With a culture built on growth, inclusivity, and global collaboration, the teams here drive innovation at scale, powered by bold thinking.

TMUS India Private Limited operates as TMUS Global Solutions.

About the Role :

As Principal Engineer – AIOps, you will be a key member of the CFL Platform Engineering and Operations team you will lead the development of AI-driven operational strategies, observability systems, and automated remediation pipelines that drive resiliency, self-healing, and real-time insight across cloud-native platforms. You will architect telemetry-rich systems, influence enterprise-wide reliability frameworks, and power the next generation of operational intelligence for large-scale AI / ML platforms.

What You’ll Do :

• Architect AI-driven pipelines for monitoring, alerting, remediation, and capacity optimization
• Lead platform observability strategy across LLMs, inference APIs, and AI model infrastructure
• Build and operate self-healing, event-driven automation systems using telemetry and anomaly detection
• Define and integrate AIOps architecture using tools like OpenTelemetry, Prometheus, Splunk, Solo Gateway, and custom LLM agents
• Partner with data science teams to turn model insights into real-time operational signals
• Lead implementation of zero-downtime operations, production-safe chaos testing, and feedback loops
• Scale observability for AI metrics : latency, token usage, drift, throughput, and cost efficiency
• Drive GitOps and CI / CD practices using GitLab and cloud-native automation
• Mentor engineers across observability, reliability, MLOps / LLMOps, and platform automation
• Collaborate with ML, platform, and SRE teams to define SLAs, escalation strategies, and platform-wide reliability goals
• Present engineering strategy, progress, and outcomes to senior leadership

What You’ll Bring :

Must Have Skills :

Nice To Have :