Software Engineer, Data Infrastructure
cohere · New York
Job description
About the role
The Data Infrastructure team at Cohere builds the storage and data‑movement layer that underpins every model training run. We are creating a unified storage system that serves petabytes of training data and model checkpoints, keeping thousands of GPUs busy across multiple clusters. This role offers the chance to design and operate that system from the ground up at massive scale.
Key responsibilities
- Design, build, and operate the distributed storage system that feeds model training and evaluation.
- Run the system on multiple Kubernetes clusters at petabyte scale.
- Collaborate with researchers and training‑infra teams to translate data‑access patterns into throughput, latency, and durability requirements.
- Address networking, I/O, and consistency challenges when moving large datasets and checkpoints across regions and backends.
Required profile
- Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management.
- Strong coding ability in Python or Go, with willingness to learn the other language.
- Experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets.
- Hands‑on experience with cloud object storage such as S3 and POSIX‑style filesystems.
Required skills
- Python
- Go
- Kubernetes
- Amazon S3
- POSIX filesystems
- Persistent Volumes
- CSI drivers
- StatefulSets
What we offer
- Weekly lunch stipend of $75 (or equivalent).
- Full health and dental benefits, including a mental‑health budget.
- RRSP matching, 401 k, and pension scheme.
- 100 % parental‑leave top‑up for up to six months.
- Annual enrichment benefits for arts, culture, fitness, and workspace improvements.
- Education and learning stipend for conferences, courses, and coaching.
- Six weeks of paid vacation (30 working days).
- Travel budget for office visits and an annual company offsite.
- Remote‑friendly policy with co‑working benefits and a $500 home‑office stipend.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salary: Senior Software Engineer Based on 42 job offers in the United StatesSalaries by job title
- Delivery Specialist 330
- Line Cook 264
- Restaurant Host 251
- Dishwasher 241
- Shift Supervisor 226
- Parts Specialist 208
- Retail Service Specialist 176
- Server - Red Robin 140
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 month ago
Expires 2 days from now
52 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
cohere
New York
Related job offers
-
ML Engineer, Forward Deployed
Prior Labs New York -
Senior Software Development Engineer, AWS Forward Deployed Engineering
Amazon (AWS) New York -
Remote Data Analyst - Product Operations
Jobs for Humanity New York -
Group Product Manager - claiR
Relativity -
Business Analyst II, Provider Data
Centene Corporation