GPU Kernel Engineer

About the role

We are seeking a highly skilled GPU Kernel Engineer to design and optimize custom GPU kernels that power next‑generation large‑scale AI systems. The role spans the full hardware‑software stack, from low‑level kernel development to integration with high‑level ML frameworks for training and inference.

Key responsibilities

• Design, implement, and optimize custom GPU kernels using C++, PTX, CUDA, ROCm, Triton, and/or JAX Pallas.
• Profile and optimize end‑to‑end performance of ML operations, focusing on large‑scale LLM training and inference.
• Integrate low‑level GPU kernels into frameworks such as PyTorch, JAX, and internal runtimes.
• Develop performance models, identify bottlenecks, and deliver kernel‑level improvements.
• Collaborate with ML researchers, distributed systems engineers, and model‑serving teams.
• Work closely with hardware vendors (NVIDIA/AMD) and stay current on GPU architecture and toolchain advances.
• Contribute to tooling, documentation, benchmarking suites, and testing frameworks.

Required profile

• 5+ years of industry or research experience in GPU kernel development or high‑performance computing.
• Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or related field.
• Strong programming skills in C++ and Python.
• Deep expertise in CUDA/ROCm, GPU memory models, and performance optimization.
• Hands‑on experience with Triton and/or JAX Pallas.
• Strong understanding of PTX, GPU assembly, and low‑level execution.
• Proven ability to integrate kernels into PyTorch, JAX, or similar frameworks.
• Experience with large‑scale LLM workloads (training or inference).

Required skills

• C++
• Python
• CUDA
• ROCm
• PTX
• GPU assembly language
• Triton
• JAX Pallas
• PyTorch
• JAX
• LLM training/inference workloads

What we offer

• Medical, dental, and vision insurance
• 401k plan
• Daily lunch, snacks, and beverages
• Flexible time off
• Competitive salary and equity
• Equal‑opportunity employment