Jobiglo

No results.

Senior Software Engineer - Dev Platform (AI Gateway)

Kraken

Senior 🇬🇧 English
Rust Python TypeScript Kubernetes CI/CD APIs LLM APIs

Job description

About the role

Kraken, founded in 2011 and trusted by over 10 million users, is looking for a Senior Software Engineer to join its Dev Platform team. This team builds the internal platform that Kraken's engineers use to build, ship and run software, and the role focuses on the AI Gateway, Kraken's company-wide LLM gateway that gives teams self-service access to models from providers such as Anthropic, OpenAI and Google.

Key responsibilities

  • Build and extend the AI Gateway: new model and provider integrations, routing policies, budgets, rate limits, and usage and cost reporting.
  • Design the APIs, SDKs and self-service tooling that let engineers onboard to the gateway quickly and safely.
  • Help teams migrate their LLM workloads onto the gateway with minimal disruption.
  • Implement access control, key management and audit logging in partnership with Security.
  • Instrument the gateway so teams can see latency, errors, token usage and cost.
  • Own features end to end, from design through production, and keep the service reliable alongside SRE.
  • Support internal users with clear documentation, debugging help and a tight feedback loop that shapes the roadmap.
  • Contribute to code review, design documents and engineering practices across Dev Platform.

Required profile

  • Solid experience as a backend or platform software engineer building and operating APIs and distributed services in production.
  • Ability to design clean, well-documented APIs for internal customers and to weigh their feedback.
  • Clear written and verbal communication, and the ownership to carry work from idea to production.

Required skills

  • Strong skills in a backend language such as Rust, Python or TypeScript, with well-tested, maintainable code.
  • Working knowledge of LLM APIs: authentication, streaming responses, token accounting, rate limits and provider failure modes.
  • Experience with observability, CI/CD and containers, and comfort with Kubernetes and a major cloud provider.
  • Nice to have: API gateways, proxies or traffic management; LLM-powered systems (routing, caching, evaluation, cost controls); OAuth, OIDC, RBAC; open-source infrastructure contributions.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Kraken.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 3 weeks ago

Expires 1 month from now

12 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

Kraken