Distributed Training and Inference Engineer
sciforium · San Francisco
Job description
About the role
Sciforium is seeking a Distributed Training and Inference Engineer to build, optimize, and maintain the software stack that powers large‑scale AI training and serving workloads. You will work across low‑level CUDA/ROCm runtimes to high‑level frameworks such as JAX and PyTorch, ensuring performance, scalability and stability.
Key responsibilities
- Maintain and optimize critical ML libraries and frameworks (JAX, PyTorch, CUDA, ROCm) across diverse hardware configurations.
- Own the end‑to‑end ML stack from drivers to high‑level tooling, continuously improving performance.
- Optimize distributed training systems, ensuring efficient sharding, partitioning and configuration for large models.
- Integrate and validate modules for runtime correctness, memory efficiency and multi‑node scalability.
- Profile compilation graphs and training workloads, eliminating bottlenecks.
- Troubleshoot complex hardware‑software interactions, including kernel‑level issues and memory leaks.
Required profile
- 5+ years of industry experience in ML systems or distributed training.
- Bachelor’s or Master’s in Computer Science, Computer/Electrical Engineering or related field.
- Strong programming skills in Python and C++.
- Deep understanding of profiling tools such as Nsight, ROCm Profiler and XLA profiler.
- Experience with multi‑node distributed training frameworks (DTensor, GSPMD, etc.).
Required skills
- Python
- C++
- JAX
- PyTorch
- CUDA
- ROCm
- Nsight
- ROCm Profiler
- XLA Profiler
- DTensor
- GSPMD
- NCCL
What we offer
- Medical, dental and vision insurance.
- 401(k) retirement plan.
- Daily lunch, snacks and beverages.
- Flexible time off.
- Competitive salary and equity.
- Equal opportunity employment.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
- Delivery Specialist 330
- Line Cook 264
- Restaurant Host 251
- Dishwasher 241
- Shift Supervisor 226
- Parts Specialist 208
- Retail Service Specialist 176
- Server - Red Robin 140
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 month ago
Expires 1 week from now
41 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
sciforium
San Francisco