Software Engineer - ML Ops (R37)

About the role

R37 is R1's AI innovation lab, building technology to transform healthcare. Its flagship platform, Phare OS, uses AI and automation to improve pre-bill workflows such as authorization, utilization management, documentation and coding, helping prevent claim denials. As a Software Engineer for the ML Ops team, you will own the production runtime for Phare's ML stack, deploying, serving and scaling models across inference endpoints and batch/streaming workflows. The role is preferred to be hybrid (3 days onsite) at the SOHO Office Hub in New York City.

Key responsibilities

• Build progressive delivery pipelines with automated rollouts and rollbacks
• Manage SLOs for latency and availability
• Instrument end-to-end observability (metrics, logs, traces, drift, regression)
• Harden the platform with Terraform, Kubernetes and CI/CD, ensuring reproducible, auditable ML releases
• Manage model registries and stage gates, and design scheduled or event-driven retraining when appropriate

Required profile

• Background in operating ML systems at scale, where uptime and feedback loops matter as much as accuracy
• Experience deploying and operating GPU-based models in production (APIs and batch/streaming inference)
• Strong platform engineering: Docker, Kubernetes, infrastructure as code (e.g. Terraform) and CI/CD for services and model artifacts, with reproducible releases and model/experiment versioning
• System reliability: progressive delivery, observability, alerting, runbooks and incident response
• Post-training lifecycle: model registries, RBAC, secrets management, encryption and audit logs
• Bonus: experience in regulated environments such as healthcare or finance

What we offer

• Base pay of $140,000 to $270,000 per year depending on level and experience
• Annual bonus plan with a target of 10%
• Flexible PTO and comprehensive health benefits
• 401(k) matching