Director of Infrastructure Engineering

About the role

Runpod is seeking a Director of Infrastructure Engineering to lead and scale its core cloud and bare‑metal environments. You will own the foundational layers of the platform, including SRE, global networking, HPC networks, and distributed storage, ensuring high availability and performance for massive GPU workloads.

Key responsibilities

• Lead multiple engineering teams responsible for Site Reliability Engineering, networking, and storage, establishing SLO/SLA definitions and incident response processes.
• Oversee design, scaling, and operation of the global network backbone and ultra‑low‑latency HPC cluster networks, including InfiniBand and RoCE implementations.
• Direct architecture and performance tuning of highly scalable distributed storage systems to meet AI/ML I/O demands.
• Hire, mentor, and grow technical managers and senior engineers, fostering a culture of ownership in a remote‑first environment.
• Partner with product and program management to forecast capacity, shape roadmaps, and translate scale challenges into measurable outcomes.
• Drive improvements in deployment frequency, MTTR, IaC coverage, and system uptime.

Required profile

• 7+ years leading software, infrastructure, SRE, or networking teams, including managing managers.
• 8+ years building and operating large‑scale distributed systems or cloud platforms.
• Hands‑on or strong architectural experience with ultra‑low latency networking (InfiniBand, RoCE, BGP).
• Experience with high‑performance distributed storage (Ceph, Lustre, Weka, NVMe‑oF).
• Proven background in SRE/DevOps, IaC (Terraform, Ansible), Kubernetes, and modern observability stacks.
• Ability to build culture and accountability across distributed technical teams.

Required skills

• Site Reliability Engineering (SRE)
• InfiniBand and RoCE networking
• Spine‑leaf architecture and BGP routing
• Distributed storage systems (Ceph, Lustre, Weka, NVMe‑oF)
• Infrastructure as Code (Terraform, Ansible)
• Kubernetes orchestration
• Observability and monitoring tools

What we offer

• Base salary $225,000‑$325,000 per year
• Equity stock options
• Generous medical, dental, and vision plans
• Flexible PTO
• Remote‑first work environment with $1,200 home office stipend