Principal Software Engineer

Overview

Join Microsoft AI, a team at the forefront of developing cutting-edge technologies. We build and operate one of the largest distributed systems in existence, powering Microsoft Ads and delivering billions of ad requests globally under tight latency, cost, and reliability constraints. Delivering relevant ads efficiently at this scale requires innovation across the full stack: models, kernels, serving systems, and GPU/accelerator infrastructure. This is a self-motivated and results-driven environment that will unleash your potential.

As a Principal Software Engineer, you will lead the design and development of low-latency, high-throughput services in C++, architect scalable microservices, and optimize system performance across CPU and GPU. You will collaborate with cross-functional teams, influence technical direction, and mentor engineers while driving engineering excellence.

Responsibilities

• Architect and build large-scale distributed systems and microservices with low latency and high throughput.
• Optimize system performance.
• Drive innovation across the entire stack.
• Lead design and code reviews, ensuring best practices and engineering excellence.
• Collaborate with partner teams (ML, infrastructure) to deliver reliable, scalable solutions.
• Mentor and guide junior engineers, fostering technical growth and leadership.
  
  

Qualifications

Required Qualifications

• Bachelor's or Master's degree in Computer Science or related field.
• 10+ years of software development experience in industry.
• Experience with coding in languages including, but not limited to, C, C++, C#, Java.
• Experience in object-oriented design, data structures, and algorithms
  
  

Preferred Qualifications

• Experience building low-latency, high-throughput backend systems in online services or similar domains.
• Experience with C++.
• Excellent leadership, collaboration, and problem-solving skills.
• Proven experience architecting and implementing large-scale distributed systems and microservices.
• Practical experience with GPU programming (CUDA or similar frameworks) and optimizations is added advantage
  
  

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Skills Required
Cuda, Algorithms, C, Java, Data Structures