Jobiglo

No results.

Senior Machine Learning Platform Engineer - Model Hosting & MLOps

hp · Spring

New
Senior 147,050 - 230,850 USD/year 🇬🇧 English
Python AWS Azure Kubernetes Terraform CI/CD MLOps

Job description

About the role

HP is hiring a Senior Machine Learning Platform Engineer to build the infrastructure and engineering workflows that move custom models from development into reliable production use. The role is hands-on: hosting LLMs on GPU infrastructure, building the cloud platform around model serving, and creating MLOps pipelines that make releases repeatable and observable. You will work with model developers, application engineers, security and cloud platform teams to turn a model artifact into a secure, scalable inference service, across AWS and Azure with possible on-premises integration.

Key responsibilities

  • Design and build hosting for custom ML and AI models on AWS and Azure, focusing on GPU-backed LLM inference and real-time endpoints, and support batch inference where appropriate.
  • Package models and dependencies into reproducible serving workloads, choosing managed services, containers or Kubernetes patterns based on throughput, latency, security, reliability and cost.
  • Provision and configure Kubernetes clusters or other hosting infrastructure, including compute, storage, API access, identity and access controls, secrets, networking, observability and environment configuration.
  • Develop infrastructure as code and deployment automation so environments can be provisioned, reviewed, promoted and maintained consistently.
  • Build MLOps workflows for model registration, versioning, validation, release, rollback and retirement, connecting training to deployment through automated pipelines and quality gates.
  • Partner with application teams to design agent workflows, including model and tool orchestration, state handling, failure recovery and evaluation.
  • Establish production monitoring for service health, latency, throughput, errors, GPU and other resource use, and share responsibility for incident diagnosis and capacity improvement.
  • Create reusable deployment templates, reference architectures, documentation and onboarding paths, and advise on trade-offs such as online versus batch inference and managed versus self-hosted serving.

Required profile

  • Hands-on experience hosting LLM inference on GPU infrastructure in production, explaining how models reached production and how throughput, latency, reliability and cost were managed.
  • Experience building a model-serving platform for custom models, including inference runtimes, deployment patterns, endpoint access, scaling and operational tooling.
  • Strong software engineering skills, especially Python, with experience building services, automation and maintainable production code.
  • Ability to work across model development, application, platform and security teams and to turn ambiguous requirements into a working design.

Required skills

  • Infrastructure for ML workloads on AWS and Azure, with infrastructure as code such as Terraform or an equivalent tool.
  • Kubernetes or another production hosting platform for containerized inference workloads.
  • ML deployment pipelines with versioned artifacts, automated validation, CI/CD, environment promotion and rollback.
  • Familiarity with LLM agent patterns and production concerns for inference services (scaling, latency, availability, logging and metrics, access control, cost).

What we offer

  • Pay range of $147,050 to $230,850 USD annually, with possible bonus and/or equity for US candidates.
  • Health, dental and vision insurance, long and short term disability, employee assistance program, flexible spending account and life insurance.
  • 4-12 weeks fully paid parental leave, 11 paid holidays and additional flexible paid vacation and sick leave.

Questions fréquentes

Le salaire proposé pour ce poste est de 147-231k USD par an. Le détail figure dans l'annonce.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:workday

Why are you reporting this job?

Thank you for your report. We will review this job.

Explore further

Salaries, guides and searches in the United States.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 4 hours ago

Expires 1 month from now

1 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

hp

Spring