AI Engineer – Build LLM API Gateway

About the role

LiteLLM is looking for an AI Engineer to help unify the way developers call large‑language‑model (LLM) APIs. You will work closely with the CEO and CTO to design and implement a provider‑agnostic gateway that simplifies OpenAI, Anthropic and other LLM specifications.

Key responsibilities

• Write transformations that convert OpenAI/Anthropic request formats to the native APIs of multiple LLM providers.
• Develop provider‑agnostic features such as session management, skill handling, compaction and batch processing.
• Design system components that support advanced provider‑level capabilities at the gateway level.
• Enhance the developer experience for millions of users via LiteLLM’s Python SDK.
• Maintain a robust LLM interoperability layer, supporting diverse authentication flows and agent use‑cases.

Required profile

• 1‑2 years of backend or full‑stack experience building production systems.
• Passion for open‑source projects and direct user engagement.
• Hands‑on experience with the OpenAI API and understanding of its chat/completions vs. responses endpoints.
• Strong work ethic, ability to thrive in a small, fast‑moving team.
• Eagerness to communicate with users and solve real‑world problems.

Required skills

• Python
• FastAPI
• Redis
• Postgres
• LLM APIs
• OpenAI API

What we offer

• Daily collaboration with the founders.
• Impactful products used by thousands of engineering teams worldwide.
• Ownership of product decisions, not just implementation.
• Fast development cycles with immediate production impact.
• Competitive salary, equity, health, dental and vision benefits.