Software Engineer, Research Data Platform

About the role

Anthropic is looking for a Software Engineer to join its Research Data Platform team in San Francisco. The role focuses on building the data infrastructure that powers the day‑to‑day work of AI researchers, turning raw training‑run outputs into searchable, well‑catalogued datasets. You will work closely with researchers to understand their workflows and deliver tools that accelerate experimentation.

Key responsibilities

• Design, build, and operate data pipelines that extract data from model training runs and load it into fast‑query storage.
• Collaborate with researchers to create APIs, libraries, and web interfaces for data management, exploration, and analysis.
• Develop dataset management, data cataloging, and provenance tooling used daily by research teams.
• Embed with research groups to identify high‑impact tooling opportunities and ship solutions quickly.
• Partner with adjacent teams to extend existing infrastructure rather than reinventing components.

Required profile

• Significant software engineering experience building data‑intensive applications or internal tooling.
• Enjoys direct interaction with technical users, iteratively gathering requirements and delivering adopted solutions.
• Results‑oriented with a bias toward flexibility and impact.
• Willingness to learn about machine‑learning research and consider societal implications of the work.

Required skills

• Large‑scale ETL processes.
• Columnar storage formats (e.g., Parquet).
• Query engines such as Spark, BigQuery, DuckDB.
• High‑volume time‑series data ingestion, storage, and efficient querying.
• Data cataloging, lineage, and metadata management.
• ML experiment tracking or metrics platforms.