Lead Engineer, ML Data Infrastructure & Systems
build-ai · San Francisco
Job description
About the role
Build AI is the data hyperscaler for Physical AI, vertically integrated across hardware, manufacturing, logistics, collection, and model training to scale physical‑labor datasets orders of magnitude faster than anyone else. We are seeking a Lead Engineer to own the end‑to‑end data platform that captures video from workers, processes it into training‑ready shards, and delivers datasets to external research customers.
Key responsibilities
- Own the data platform end‑to‑end, from on‑device capture through upload over flaky bandwidth, object storage, and training‑ready shard generation.
- Design and implement compression, codecs, and storage‑tier trade‑offs to keep 1080p30 video cheap at petabyte scale.
- Build robust upload pipelines with on‑device buffering, batching, retries, and observable drop‑rate metrics.
- Define object‑storage formats and training‑shard packaging, versioning, and delivery to external customers.
- Collaborate with firmware teams in Shenzhen to standardise ingest contracts across device SKUs.
- Make health, cost, and drop‑rate metrics visible as the platform expands globally.
Required profile
- Experience owning a production media or sensor data path at petabyte scale, including object storage, video codecs, compression, or training‑shard formats.
- Strong software engineering background with Python and at least one systems language on Linux.
- Proven ability to measure cost and throughput rather than just demo uploads.
- Desire to scale in‑the‑wild physical‑labor video rather than run a generic data organisation.
Required skills
- Python
- Linux
- AWS or GCP
- Kubernetes
- Airflow
- Temporal
- Infrastructure as Code (IaC)
- Video codecs and compression
What we offer
- Competitive salary and comprehensive medical, dental, and vision coverage.
- $500 monthly credit for waiving medical benefits.
- Housing subsidy of $2,000 per month for nearby office locations.
- Relocation support to San Francisco (Financial District) or Shenzhen (Nanshan).
- Wellness benefits covering fitness, mental health, and more.
- Daily lunch and dinner on‑site, unlimited compute budget (ROI‑justified), and unlimited Codex and Claude credits.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Published 5 hours ago
Expires 1 month from now
1 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
build-ai
San Francisco