Jobiglo

No results.

Lead Engineer, ML Data Infrastructure & Systems

build-ai · San Francisco

New
🇬🇧 English
Python Linux AWS GCP Kubernetes Airflow Temporal IaC Video codecs Compression

Job description

About the role

Build AI is the data hyperscaler for Physical AI, vertically integrated across hardware, manufacturing, logistics, collection, and model training to scale physical‑labor datasets orders of magnitude faster than anyone else. We are seeking a Lead Engineer to own the end‑to‑end data platform that captures video from workers, processes it into training‑ready shards, and delivers datasets to external research customers.

Key responsibilities

  • Own the data platform end‑to‑end, from on‑device capture through upload over flaky bandwidth, object storage, and training‑ready shard generation.
  • Design and implement compression, codecs, and storage‑tier trade‑offs to keep 1080p30 video cheap at petabyte scale.
  • Build robust upload pipelines with on‑device buffering, batching, retries, and observable drop‑rate metrics.
  • Define object‑storage formats and training‑shard packaging, versioning, and delivery to external customers.
  • Collaborate with firmware teams in Shenzhen to standardise ingest contracts across device SKUs.
  • Make health, cost, and drop‑rate metrics visible as the platform expands globally.

Required profile

  • Experience owning a production media or sensor data path at petabyte scale, including object storage, video codecs, compression, or training‑shard formats.
  • Strong software engineering background with Python and at least one systems language on Linux.
  • Proven ability to measure cost and throughput rather than just demo uploads.
  • Desire to scale in‑the‑wild physical‑labor video rather than run a generic data organisation.

Required skills

  • Python
  • Linux
  • AWS or GCP
  • Kubernetes
  • Airflow
  • Temporal
  • Infrastructure as Code (IaC)
  • Video codecs and compression

What we offer

  • Competitive salary and comprehensive medical, dental, and vision coverage.
  • $500 monthly credit for waiving medical benefits.
  • Housing subsidy of $2,000 per month for nearby office locations.
  • Relocation support to San Francisco (Financial District) or Shenzhen (Nanshan).
  • Wellness benefits covering fitness, mental health, and more.
  • Daily lunch and dinner on‑site, unlimited compute budget (ROI‑justified), and unlimited Codex and Claude credits.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec build-ai.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:ashby

Why are you reporting this job?

Thank you for your report. We will review this job.

Explore further

Salaries, guides and searches in the United States.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

By continuing, you accept our terms of use.

Already have an account? Login

💬 Chat with us on Telegram Chat on WhatsApp

Published 5 hours ago

Expires 1 month from now

1 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

build-ai

San Francisco