AI Benchmark Engineer (Planning/Operations)

About the role

Turing is seeking an AI Benchmark Engineer specialized in planning and operations to create sophisticated multi‑agent benchmark tasks that emulate real‑world scheduling and decision‑making scenarios. You will work remotely with a global team of AI researchers and engineers.

Key responsibilities

• Design and develop multi‑agent benchmark tasks covering planning, scheduling, resource allocation, and operational decision‑making.
• Craft constraint‑rich problem statements with interacting variables and dependencies.
• Write verification scripts to assess feasibility, completeness, and optimality of solutions.
• Build decomposition strategies that split tasks across specialized sub‑agents (resource‑based, conflict‑resolution, optimization).
• Model realistic operational scenarios with timelines, dependencies, and resource limits.
• Collaborate with peers to improve benchmark quality, coverage, and evaluation rigor.

Required profile

• 5+ years of experience in operations, project management, logistics, or supply‑chain management.
• Strong ability to formalize constraints, dependencies, and scheduling logic.
• Proficiency in Python for building verification and validation scripts.
• Clear technical writing and structured problem‑solving skills.
• Experience with AI coding benchmarks such as SWE‑bench or Terminal‑bench.
• Hands‑on experience with Docker (Dockerfiles, image builds, debugging).

Required skills

• Python
• Docker

What we offer

• Fully remote work environment.
• Opportunity to contribute to cutting‑edge AI projects with leading LLM companies.
• Flexible 40‑hour week with a 4‑hour overlap in PST.