Staff MaaS Backend Engineer
bitdeer
Job description
About the role
Bitdeer is looking for a Staff Backend Engineer to redesign its Model‑as‑a‑Service platform into a commercial, globally distributed, multi‑tenant token service that supports millions of active users and high token throughput.
Key responsibilities
- Co‑own the end‑to‑end MaaS system design with the Principal Architect, author decision records and enforce technical trade‑offs.
- Own the API contract for major formats (OpenAI, Anthropic), implement streaming, tool calling and structured output.
- Optimize token throughput, KV cache tiering and time‑to‑first‑token latency at p95/p99 levels.
- Scale the platform globally with regional inference pools, active‑active control plane and strict SLOs.
- Enforce multi‑tenant isolation, fail‑closed authorization and secure API key lifecycle.
- Build an exactly‑once metering and billing system with idempotent usage ledger.
- Execute zero‑downtime migrations using strangler patterns, shadow traffic and dual‑writes.
Required profile
- 8+ years of backend engineering experience, including 3+ years leading high‑traffic, multi‑tenant API platforms.
- Proven track record of zero‑downtime migrations for stateful subsystems.
- Strong systems‑level understanding of LLM serving, streaming and caching.
- Experience with on‑call responsibilities and blameless incident reviews.
Required skills
- Go programming language
- Kubernetes (including Envoy and GPU‑aware scheduling)
- PostgreSQL, Redis, Kafka
- OpenTelemetry and high‑cardinality analytics
- API design and multi‑tenant security
- Performance engineering for token throughput and latency
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 week ago
Expires 1 month from now
12 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
bitdeer