Member of Technical Staff, Inference
radical-numerics · San Francisco
Job description
About the role
Radical Numerics is seeking a Member of Technical Staff, Inference to build and optimise systems that bring cutting‑edge biological AI models into production. You will work at the intersection of AI systems, distributed computing and model deployment to deliver high‑performance inference for large‑scale genome and multimodal models.
Key responsibilities
- Identify and eliminate bottlenecks across the inference stack, from model execution and memory management to networking, scheduling and hardware utilisation.
- Develop high‑performance inference primitives, including GPU kernels, numerical operators and serving infrastructure for modern accelerator platforms.
- Partner with external customers such as pharmaceutical companies, biotech organisations and government partners to deploy models in production environments.
- Build scalable deployment infrastructure for serving, monitoring, benchmarking and operating foundation models across cloud, enterprise and secure environments.
- Collaborate with research and platform teams to ensure new model architectures can be efficiently deployed at scale.
Required profile
- Proven experience optimizing, deploying and operating large language models or other foundation models in production.
- Strong performance‑engineering and kernel‑development skills with deep understanding of GPU architectures.
- Systems‑level thinking ability to diagnose and solve bottlenecks across the full stack.
- Hands‑on builder with solid software‑engineering fundamentals in Python and modern ML frameworks such as PyTorch.
- Excellent technical communication and ability to work with cross‑functional research, engineering and scientific teams.
Required skills
- Python
- PyTorch
- CUDA or Triton
- GPU kernel optimisation
- Inference frameworks (e.g., vLLM, TensorRT‑LLM, SGLang, DeepSpeed)
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 2 days ago
Expires 1 month from now
6 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
radical-numerics
San Francisco