Senior Software Engineer – AI Infrastructure (Rust)

About the role

Kraken, founded in 2011 and part of the Payward group, is looking for a Senior Software Engineer to join its AI Infrastructure team. The team builds and operates the production systems that power intelligent agents at scale, covering model inference, orchestration and execution layers. It works closely with the Agent Systems team and partners, owning the core primitives that let agents run safely across internal systems. The environment is high-scale and high-stakes, serving millions of users.

Key responsibilities

• Design and build the infrastructure layer powering AI agent systems in production
• Develop high-performance Rust services for model inference, orchestration and execution
• Architect scalable systems able to support millions of users and high request throughput
• Build reliable ML infrastructure and MLOps patterns for deployment, evaluation and monitoring
• Define guardrails, observability and failure handling for agent-driven workflows
• Optimize latency, throughput and cost across inference and orchestration layers
• Turn experimental prototypes into hardened production systems with the Agent Systems team

Required profile

• 5+ years of experience building and operating high-scale production systems
• Experience operating services serving millions of users or high-throughput workloads
• Familiarity with ML infrastructure, model serving or MLOps in production
• Experience designing observability, monitoring and failure recovery systems
• Strong collaboration skills across infrastructure and applied engineering teams
• Nice to have: infrastructure for agent-based or LLM-powered systems, high-performance networking or async systems, container orchestration and cloud-native infrastructure, evaluation frameworks, and 0 to 1 or platform-building teams

Required skills

• Strong proficiency in Rust and systems-level programming
• Distributed systems, reliability engineering and performance optimization
• Observability and monitoring design