Jobiglo

No results.

Engineering Manager, GPU Infrastructure

cohere · San Francisco

New Remote
Remote 🇬🇧 English
Kubernetes Infrastructure monitoring GPU networking Multi-cloud

Job description

About the role

As an Engineering Manager you will lead a team of GPU infrastructure engineers, set technical direction, grow people, and help the company scale a rapidly growing compute footprint.

Key responsibilities

  • Hire, mentor, and grow a team of GPU infrastructure engineers, providing performance guidance and solving hard infrastructure problems.
  • Own the technical roadmap for the fleet, including deployment, operation, and scaling of Kubernetes clusters, workload scheduling, hardware fault detection, and performance.
  • Partner with researchers and ML engineers to ensure the training and inference stack works well on new GPU architectures.
  • Collaborate with cross‑functional stakeholders (Capacity, Finance, Legal, Security, other infrastructure teams) on planning, cost, compliance, and shared dependencies.
  • Drive operational excellence through observability of GPU utilization, automation of cluster provisioning, cost optimization, and vendor relationship management.

Required profile

  • Experience managing engineering or SRE teams, with a focus on mentorship, hiring, and growth, including remote, distributed settings.
  • Background running large Kubernetes compute fleets in production, multi‑cloud environments, multi‑cluster operations, scheduling, node health at scale, and familiarity with IaC and infrastructure monitoring.
  • Deep expertise in one layer of a GPU training fleet (cluster‑wide operations, GPU networking, or hardware) with a willingness to get hands‑on across the stack.
  • Experience with cost optimization and capacity planning for GPU infrastructure.
  • Track record of partnering with researchers or ML engineers and making data‑informed trade‑offs across reliability, cost, and delivery.

Required skills

  • Kubernetes
  • Infrastructure as Code (IaC)
  • Infrastructure monitoring
  • GPU networking
  • Multi‑cloud environments

What we offer

  • Weekly lunch stipend of $75 (or equivalent in local currency).
  • Full health and dental benefits, plus a separate mental‑health budget.
  • RRSP matching, 401(k), and pension scheme.
  • 100% parental‑leave top‑up for up to 6 months for either parent.
  • Annual enrichment benefits covering arts, culture, fitness, wellness, quality time, and workspace improvement credit.
  • Education and learning stipend for conferences, courses, and coaching.
  • 6 weeks of paid vacation (30 working days).
  • Budget for travel to other offices and an annual company offsite.
  • $500 home‑office stipend and co‑working benefit for remote employees.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec cohere.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:ashby

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

By continuing, you accept our terms of use.

Already have an account? Login

💬 Chat with us on Telegram Chat on WhatsApp

Published 5 hours ago

Expires 1 month from now

2 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

cohere

San Francisco