Principal Systems Performance Engineer

Our vision is to transform how the world uses information to enrich life for all .

Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.

Principal / Senior Systems Performance Engineer

Micron Data Center and Client Workload Engineering in Hyderabad, India, is seeking a senior / principal engineer to join our dynamic team.

The successful candidate will primarily contribute to the ML development, ML DevOps, HBM program in the data center by analyzing how AI / ML workloads perform on the latest MU-HBM, Micron main memory, expansion memory and near memory (HBM / LP) solutions, conduct competitive analysis, showcase the benefits that workloads see with MU-HBM's capacity / bandwidth / thermals, contribute to marketing collateral, and extract AI / ML workload traces to help optimize future HBM designs.

Job Responsibilities :

The Job Responsibilities include but are not limited to the following :

• Design, implement, and maintain scalable & reliable ML infrastructure and pipelines.
• Collaborate with data scientists and ML engineers to deploy machine learning models into production environments.
• Automate and optimize ML workflows, including data preprocessing, model training, evaluation, and deployment.
• Monitor and manage the performance, reliability, and scalability of ML systems.
• Troubleshoot and resolve issues related to ML infrastructure and deployments.
• Implement and manage distributed training and inference solutions to enhance model performance and scalability.
• Utilize DeepSpeed, TensorRT, vLLM for optimizing and accelerating AI inference and training processes.
• Understand key care abouts when it comes to ML models such as : transformer architectures, precision, quantization, distillation, attention span & KV cache, MoE, etc.
• Build workload memory access traces from AI models.
• Study system balance ratios for DRAM to HBM in terms of capacity and bandwidth to understand and model TCO.
• Study data movement between CPU, GPU and the associated memory subsystems (DDR, HBM) in heterogeneous system architectures via connectivity such as PCIe / NVLINK / Infinity Fabric to understand the bottlenecks in data movement for different workloads.
• Develop an automated testing framework through scripting.
• Customer engagements and conference presentations to showcase findings and develop whitepapers.

Requirements :

Preferred Qualifications :

Education :

About Micron Technology, Inc.

We are an industry leader in innovative memory and storage solutions transforming how the world uses information to enrich life for all . With a relentless focus on our customers, technology leadership, and manufacturing and operational excellence, Micron delivers a rich portfolio of high-performance DRAM, NAND, and NOR memory and storage products through our Micron® and Crucial® brands. Every day, the innovations that our people create fuel the data economy, enabling advances in artificial intelligence and 5G applications that unleash opportunities - from the data center to the intelligent edge and across the client and mobile user experience.

To learn more, please visit micron.com / careers

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

To request assistance with the application process and / or for reasonable accommodations,please contact

Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.

Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.

AI alert : Candidates are encouraged to use AI tools to enhance their resume and / or application materials. However, all information provided must be accurate and reflect the candidate's true skills and experiences. Misuse of AI to fabricate or misrepresent qualifications will result in immediate disqualification.

Fraud alert : Micron advises job seekers to be cautious of unsolicited job offers and to verify the authenticity of any communication claiming to be from Micron by checking the official Micron careers website in the About Micron Technology, Inc.

Skills Required

C, Pytorch, Cuda, Tensorflow, Python, Pcie