Rust Engineer

About the role

LiteLLM is the world’s most popular AI gateway, trusted by companies such as Adobe, Netflix and NASA. We are looking for an experienced Rust engineer to lead the migration of our platform from Python to Rust, delivering the fastest, most reliable AI gateway.

Key responsibilities

• Own the end‑to‑end migration of LiteLLM from Python to Rust, from architecture design through production rollout.
• Plan migration steps together with the CTO, sequencing work to minimise risk to high‑volume traffic.
• Design and execute a gradual, stability‑first rollout while maintaining service reliability.
• Refactor the existing codebase to enable clean, incremental migration to Rust.
• Drive performance improvements in latency, throughput and resource efficiency for a system handling over 1 billion requests per month.
• Collaborate with backend, performance, reliability and security teams to align migration goals.

Required profile

• Deep, long‑standing expertise in production Rust development.
• Strong obsession with performance, latency and throughput.
• Proven ability to balance ambitious changes with system stability.
• Experience leading large‑scale codebase migrations is a major plus.
• History of shipping performance‑critical systems is a major plus.

Required skills

• Rust
• Python
• PostgreSQL
• Redis

What we offer

• Ownership of a critical technical initiative on the company roadmap.
• Opportunity to define the architectural foundation for the entire platform.
• Fast‑paced growth environment with deep technical ownership.
• Competitive salary and comprehensive health, dental and vision benefits.