Engineering Manager, GPU Infrastructure
cohere · San Francisco
Job description
About the role
As an Engineering Manager you will lead a team of GPU infrastructure engineers, set technical direction, grow people, and help the company scale a rapidly growing compute footprint.
Key responsibilities
- Hire, mentor, and grow a team of GPU infrastructure engineers, providing performance guidance and solving hard infrastructure problems.
- Own the technical roadmap for the fleet, including deployment, operation, and scaling of Kubernetes clusters, workload scheduling, hardware fault detection, and performance.
- Partner with researchers and ML engineers to ensure the training and inference stack works well on new GPU architectures.
- Collaborate with cross‑functional stakeholders (Capacity, Finance, Legal, Security, other infrastructure teams) on planning, cost, compliance, and shared dependencies.
- Drive operational excellence through observability of GPU utilization, automation of cluster provisioning, cost optimization, and vendor relationship management.
Required profile
- Experience managing engineering or SRE teams, with a focus on mentorship, hiring, and growth, including remote, distributed settings.
- Background running large Kubernetes compute fleets in production, multi‑cloud environments, multi‑cluster operations, scheduling, node health at scale, and familiarity with IaC and infrastructure monitoring.
- Deep expertise in one layer of a GPU training fleet (cluster‑wide operations, GPU networking, or hardware) with a willingness to get hands‑on across the stack.
- Experience with cost optimization and capacity planning for GPU infrastructure.
- Track record of partnering with researchers or ML engineers and making data‑informed trade‑offs across reliability, cost, and delivery.
Required skills
- Kubernetes
- Infrastructure as Code (IaC)
- Infrastructure monitoring
- GPU networking
- Multi‑cloud environments
What we offer
- Weekly lunch stipend of $75 (or equivalent in local currency).
- Full health and dental benefits, plus a separate mental‑health budget.
- RRSP matching, 401(k), and pension scheme.
- 100% parental‑leave top‑up for up to 6 months for either parent.
- Annual enrichment benefits covering arts, culture, fitness, wellness, quality time, and workspace improvement credit.
- Education and learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days).
- Budget for travel to other offices and an annual company offsite.
- $500 home‑office stipend and co‑working benefit for remote employees.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Published 5 hours ago
Expires 1 month from now
2 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
cohere
San Francisco