Member of Technical Staff, ML Engineer
radical-numerics · San Francisco
Job description
About the role
The Member of Technical Staff, ML Engineer owns the layer between the models and the users, building APIs, batch and compute systems that make inference fast, reliable, and cost‑effective at genome scale. You will work closely with scientists, partners, and product teams to deliver the next‑generation genome language model, Omnii.
Key responsibilities
- Build real‑time and large‑batch inference APIs for genome‑scale workloads, optimizing latency, throughput and cost.
- Design and operate the compute orchestration layer, including job queues, autoscaling GPU inference, fault tolerance, and observability to meet SLAs.
- Develop the developer‑facing product: API surface, SDKs, and documentation for external teams.
- Reduce inference cost and latency, package the platform for on‑premise and air‑gapped partner environments.
Required profile
- Experience building and operating backend or distributed systems at production scale with a focus on reliability.
- Proven track record shipping a model‑as‑a‑service used by other teams.
- Comfort with ambiguity and ownership of early‑stage technical roles.
Required skills
- Production‑grade Python programming.
- Proficiency in at least one typed language (e.g., Go, Java, C++).
- Containerization and infrastructure‑as‑code experience.
- Knowledge of GPU inference frameworks such as vLLM, TensorRT‑LLM, or Triton.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 2 days ago
Expires 1 month from now
5 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
radical-numerics
San Francisco