Jobiglo

No results.

Senior Technology Enablement Engineer (AI Infrastructure)

kla · Ann Arbor

New
Senior 129,600 - 190,067 USD/year 🇬🇧 English
Kubernetes Ray PyTorch JAX vLLM SGLang NVIDIA Dynamo CUDA NCCL DCGM GitOps Infrastructure-as-code Python Linux

Job description

About the role

KLA's IT group supports business growth and productivity by connecting people, process and technology worldwide, focusing on empowering employees' use of technology. This role is a Senior Software Engineer specializing in AI infrastructure, owning cluster architecture, distributed workload orchestration, accelerator management, performance engineering and open-source integration. TPU experience is optional.

Key responsibilities

  • Design and deploy scalable, multi-node GPU clusters on Kubernetes, covering compute, networking, storage, scheduling, security and observability.
  • Build distributed training and reinforcement learning platforms using Ray and NVIDIA NeMo RL, supporting PyTorch and JAX.
  • Deploy and optimize high-throughput LLM inference using vLLM, SGLang and NVIDIA Dynamo.
  • Implement GPU scheduling, quotas, isolation, autoscaling, health monitoring and capacity management for multi-tenant environments.
  • Profile and troubleshoot GPU workloads with NVIDIA Nsight Systems, Nsight Compute, DCGM, CUDA and NCCL.
  • Automate cluster provisioning, upgrades, workload deployment and recovery with infrastructure-as-code and GitOps.
  • Contribute to open-source AI infrastructure projects and bring upstream best practices into the platform.

Required profile

  • Bachelor's degree and eight years of software engineering experience.
  • Four years in software, cloud, platform, HPC or systems engineering, including two years supporting distributed AI/ML workloads.
  • Proven hands-on experience building and running GPU clusters at production scale.
  • Demonstrated open-source contribution, maintainership or meaningful participation in an AI infrastructure project.

Required skills

  • Deep Kubernetes expertise (operators, CRDs, Helm, networking, storage, scheduling, lifecycle management).
  • Production experience with Ray and at least two of: NVIDIA NeMo RL, vLLM, SGLang, NVIDIA Dynamo.
  • NVIDIA GPU knowledge, CUDA, NCCL, GPU Operator, DCGM, MIG, RDMA and multi-node collective communication.
  • Debugging training and inference performance across GPU, CPU, memory, network and storage layers.
  • Python, Linux, containers, CI/CD, GitOps, infrastructure-as-code and platform observability.

Preferred qualifications

  • Google TPU experience and TPU-oriented frameworks or distributed workloads.
  • LLM training, fine-tuning, RLHF or agentic reinforcement learning.
  • TensorRT-LLM, Triton Inference Server, DeepSpeed, Megatron-LM or similar frameworks.
  • Operating secure, multi-tenant AI platforms in enterprise or regulated environments.

What we offer

  • Base pay range of $129,600 to $190,067 annually.
  • Medical, dental, vision, life and other voluntary benefits, 401(k) with company matching, ESPP, student debt assistance and tuition reimbursement.
  • Wellness benefits including an EAP, paid time off, paid holidays and family care and bonding leave.

Questions fréquentes

Le salaire proposé pour ce poste est de 130-190k USD par an. Le détail figure dans l'annonce.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:workday

Why are you reporting this job?

Thank you for your report. We will review this job.

Explore further

Salaries, guides and searches in the United States.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 4 days ago

Expires 1 month from now

8 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

kla

Ann Arbor