Machine Learning Infrastructure Engineer

About the role

We’re looking for seasoned ML Infrastructure engineers with experience designing, building and maintaining training and serving infrastructure for ML research.

Character.AI empowers people to connect, learn and tell stories through interactive entertainment. Over 20 million monthly users engage with the platform, which was recently recognized as Google Play’s AI App of the Year.

Key responsibilities

• Provide infrastructure support to ML research and product teams.
• Build tooling to diagnose cluster issues and hardware failures.
• Monitor deployments, manage experiments, and support research workflows.
• Maximize GPU allocation and utilization for both serving and training workloads.

Required profile

• 4+ years of experience supporting infrastructure in an ML environment.
• Experience developing tools to diagnose ML infrastructure problems and failures.
• Proficiency with cloud platforms such as Google Compute Engine, Kubernetes, and Cloud Storage.
• Hands‑on experience working with GPUs.

Required skills

• Experience with large GPU clusters and high‑performance computing/networking (nice to have).
• Familiarity with large language model training (nice to have).
• Knowledge of ML frameworks such as PyTorch, TensorFlow, or JAX (nice to have).
• GPU kernel development experience (nice to have).