Sr GPU Cloud K8S Expert (SRE SME)

About the role

Bitdeer is building an AI‑operated GPU cloud called NeoCloud. As a Senior GPU Cloud Kubernetes Expert you will design, deploy, and operate the control plane that powers topology‑aware scheduling, self‑healing, and automated remediation for large‑scale GPU workloads.

Key responsibilities

• Design, deploy and operate production Kubernetes clusters optimized for 100–10,000 GPUs.
• Implement Nvidia GPU operator, device plugins, MIG configuration and GPU time‑slicing policies.
• Develop topology‑aware scheduling using GPU locality, NVLink domain awareness and network rail affinity.
• Create and maintain Custom Resource Definitions (CRDs) for GPU workload lifecycle management.
• Integrate AI frameworks such as Slurm, Ray and Kubeflow on Kubernetes.
• Ensure multi‑tenant isolation via namespaces, network policies, resource quotas, RBAC and pod security standards.
• Automate Bare‑Metal‑as‑a‑Service provisioning, tenant onboarding and resource reclamation using Terraform.
• Define and monitor SLIs/SLOs for cluster availability, job completion rates and provisioning latency.
• Lead incident management with runbook automation, escalation procedures and post‑incident reviews.
• Maintain monitoring stack (Prometheus, Grafana, Alertmanager, PagerDuty) and automate GPU node failure handling.

Required profile

• Extensive experience managing production Kubernetes clusters at GPU scale.
• Deep knowledge of Nvidia GPU operator, device plugins and MIG.
• Proven ability to design topology‑aware scheduling and multi‑tenant isolation.
• Strong background in infrastructure‑as‑code with Terraform.
• Experience with AI/ML workload orchestration (Slurm, Ray, Kubeflow).
• Solid understanding of monitoring, alerting and incident response processes.

Required skills

• Kubernetes
• Nvidia GPU operator
• Terraform
• Prometheus
• Grafana
• Alertmanager
• PagerDuty
• Slurm
• Ray
• Kubeflow

What we offer

• Competitive salary range $180,000–$260,000 per year.
• Remote‑first work environment.
• Opportunity to shape cutting‑edge AI cloud infrastructure.