Senior Technology Enablement Engineer (AI Infrastructure)
kla · Ann Arbor
Job description
About the role
KLA's IT group supports business growth and productivity by connecting people, process and technology worldwide, focusing on empowering employees' use of technology. This role is a Senior Software Engineer specializing in AI infrastructure, owning cluster architecture, distributed workload orchestration, accelerator management, performance engineering and open-source integration. TPU experience is optional.
Key responsibilities
- Design and deploy scalable, multi-node GPU clusters on Kubernetes, covering compute, networking, storage, scheduling, security and observability.
- Build distributed training and reinforcement learning platforms using Ray and NVIDIA NeMo RL, supporting PyTorch and JAX.
- Deploy and optimize high-throughput LLM inference using vLLM, SGLang and NVIDIA Dynamo.
- Implement GPU scheduling, quotas, isolation, autoscaling, health monitoring and capacity management for multi-tenant environments.
- Profile and troubleshoot GPU workloads with NVIDIA Nsight Systems, Nsight Compute, DCGM, CUDA and NCCL.
- Automate cluster provisioning, upgrades, workload deployment and recovery with infrastructure-as-code and GitOps.
- Contribute to open-source AI infrastructure projects and bring upstream best practices into the platform.
Required profile
- Bachelor's degree and eight years of software engineering experience.
- Four years in software, cloud, platform, HPC or systems engineering, including two years supporting distributed AI/ML workloads.
- Proven hands-on experience building and running GPU clusters at production scale.
- Demonstrated open-source contribution, maintainership or meaningful participation in an AI infrastructure project.
Required skills
- Deep Kubernetes expertise (operators, CRDs, Helm, networking, storage, scheduling, lifecycle management).
- Production experience with Ray and at least two of: NVIDIA NeMo RL, vLLM, SGLang, NVIDIA Dynamo.
- NVIDIA GPU knowledge, CUDA, NCCL, GPU Operator, DCGM, MIG, RDMA and multi-node collective communication.
- Debugging training and inference performance across GPU, CPU, memory, network and storage layers.
- Python, Linux, containers, CI/CD, GitOps, infrastructure-as-code and platform observability.
Preferred qualifications
- Google TPU experience and TPU-oriented frameworks or distributed workloads.
- LLM training, fine-tuning, RLHF or agentic reinforcement learning.
- TensorRT-LLM, Triton Inference Server, DeepSpeed, Megatron-LM or similar frameworks.
- Operating secure, multi-tenant AI platforms in enterprise or regulated environments.
What we offer
- Base pay range of $129,600 to $190,067 annually.
- Medical, dental, vision, life and other voluntary benefits, 401(k) with company matching, ESPP, student debt assistance and tuition reimbursement.
- Wellness benefits including an EAP, paid time off, paid holidays and family care and bonding leave.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
- Delivery Specialist 330
- Line Cook 264
- Restaurant Host 251
- Dishwasher 241
- Shift Supervisor 226
- Parts Specialist 208
- Retail Service Specialist 176
- Server - Red Robin 140
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 4 days ago
Expires 1 month from now
8 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
kla
Ann Arbor