Senior Machine Learning Platform Engineer - Model Hosting & MLOps
hp · Spring
Job description
About the role
HP is hiring a Senior Machine Learning Platform Engineer to build the infrastructure and engineering workflows that move custom models from development into reliable production use. The role is hands-on: hosting LLMs on GPU infrastructure, building the cloud platform around model serving, and creating MLOps pipelines that make releases repeatable and observable. You will work with model developers, application engineers, security and cloud platform teams to turn a model artifact into a secure, scalable inference service, across AWS and Azure with possible on-premises integration.
Key responsibilities
- Design and build hosting for custom ML and AI models on AWS and Azure, focusing on GPU-backed LLM inference and real-time endpoints, and support batch inference where appropriate.
- Package models and dependencies into reproducible serving workloads, choosing managed services, containers or Kubernetes patterns based on throughput, latency, security, reliability and cost.
- Provision and configure Kubernetes clusters or other hosting infrastructure, including compute, storage, API access, identity and access controls, secrets, networking, observability and environment configuration.
- Develop infrastructure as code and deployment automation so environments can be provisioned, reviewed, promoted and maintained consistently.
- Build MLOps workflows for model registration, versioning, validation, release, rollback and retirement, connecting training to deployment through automated pipelines and quality gates.
- Partner with application teams to design agent workflows, including model and tool orchestration, state handling, failure recovery and evaluation.
- Establish production monitoring for service health, latency, throughput, errors, GPU and other resource use, and share responsibility for incident diagnosis and capacity improvement.
- Create reusable deployment templates, reference architectures, documentation and onboarding paths, and advise on trade-offs such as online versus batch inference and managed versus self-hosted serving.
Required profile
- Hands-on experience hosting LLM inference on GPU infrastructure in production, explaining how models reached production and how throughput, latency, reliability and cost were managed.
- Experience building a model-serving platform for custom models, including inference runtimes, deployment patterns, endpoint access, scaling and operational tooling.
- Strong software engineering skills, especially Python, with experience building services, automation and maintainable production code.
- Ability to work across model development, application, platform and security teams and to turn ambiguous requirements into a working design.
Required skills
- Infrastructure for ML workloads on AWS and Azure, with infrastructure as code such as Terraform or an equivalent tool.
- Kubernetes or another production hosting platform for containerized inference workloads.
- ML deployment pipelines with versioned artifacts, automated validation, CI/CD, environment promotion and rollback.
- Familiarity with LLM agent patterns and production concerns for inference services (scaling, latency, availability, logging and metrics, access control, cost).
What we offer
- Pay range of $147,050 to $230,850 USD annually, with possible bonus and/or equity for US candidates.
- Health, dental and vision insurance, long and short term disability, employee assistance program, flexible spending account and life insurance.
- 4-12 weeks fully paid parental leave, 11 paid holidays and additional flexible paid vacation and sick leave.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
- Delivery Specialist 330
- Line Cook 264
- Restaurant Host 251
- Dishwasher 241
- Shift Supervisor 226
- Parts Specialist 208
- Retail Service Specialist 176
- Server - Red Robin 140
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 4 hours ago
Expires 1 month from now
1 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
hp
Spring