Senior Software Engineer - Dev Platform (AI Gateway)
Kraken
Job description
About the role
Kraken, founded in 2011 and trusted by over 10 million users, is looking for a Senior Software Engineer to join its Dev Platform team. This team builds the internal platform that Kraken's engineers use to build, ship and run software, and the role focuses on the AI Gateway, Kraken's company-wide LLM gateway that gives teams self-service access to models from providers such as Anthropic, OpenAI and Google.
Key responsibilities
- Build and extend the AI Gateway: new model and provider integrations, routing policies, budgets, rate limits, and usage and cost reporting.
- Design the APIs, SDKs and self-service tooling that let engineers onboard to the gateway quickly and safely.
- Help teams migrate their LLM workloads onto the gateway with minimal disruption.
- Implement access control, key management and audit logging in partnership with Security.
- Instrument the gateway so teams can see latency, errors, token usage and cost.
- Own features end to end, from design through production, and keep the service reliable alongside SRE.
- Support internal users with clear documentation, debugging help and a tight feedback loop that shapes the roadmap.
- Contribute to code review, design documents and engineering practices across Dev Platform.
Required profile
- Solid experience as a backend or platform software engineer building and operating APIs and distributed services in production.
- Ability to design clean, well-documented APIs for internal customers and to weigh their feedback.
- Clear written and verbal communication, and the ownership to carry work from idea to production.
Required skills
- Strong skills in a backend language such as Rust, Python or TypeScript, with well-tested, maintainable code.
- Working knowledge of LLM APIs: authentication, streaming responses, token accounting, rate limits and provider failure modes.
- Experience with observability, CI/CD and containers, and comfort with Kubernetes and a major cloud provider.
- Nice to have: API gateways, proxies or traffic management; LLM-powered systems (routing, caching, evaluation, cost controls); OAuth, OIDC, RBAC; open-source infrastructure contributions.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salary: Senior Software Engineer Based on 42 job offers in the United StatesSalaries by job title
- Delivery Specialist 330
- Line Cook 264
- Restaurant Host 251
- Dishwasher 242
- Shift Supervisor 226
- Parts Specialist 208
- Retail Service Specialist 176
- Server - Red Robin 140
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 3 weeks ago
Expires 1 month from now
12 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Kraken