AI Infrastructure Engineer

About the role

AMAX, a provider of GPU-accelerated IT infrastructure, is hiring an AI Infrastructure Engineer in Fremont. You will design, build and operate on-prem infrastructure that behaves like a cloud environment for internal teams, including AI/ML workloads, while supporting customers collocated in the HostMax datacenter.

Key responsibilities

• Own datacenter and infrastructure operations: compute, storage, networking and the automation layered on top.
• Build and maintain Infrastructure-as-Code with Terraform (Terragrunt), Ansible and similar tools.
• Deploy, secure and operate the HashiCorp stack (Vault, Boundary) alongside identity and access via Keycloak.
• Run observability with Prometheus, Grafana and Alertmanager.
• Deploy and manage containerized workloads with Docker and Kubernetes.
• Design and maintain networking: VLANs, routing, firewall rules and load balancers.
• Write scripts and tools to automate operational toil, and contribute code where useful.
• Provide general datacenter support for collocated customers (cabling, hardware swaps, rack/stack work, basic troubleshooting).
• Take part in business-hours (M-F) on-call rotation for customer and infrastructure support.
• Work in an SDLC/Scrum workflow using Jira and Confluence, and help define standards, runbooks and best practices.
• Develop and deploy AI infrastructure workloads on-prem, including GPU scheduling, model serving infrastructure and self-hosted AI tooling.

Required profile

• Solid experience with Infrastructure-as-Code and Configuration-as-Code.
• Real-world on-prem/datacenter operations experience; this is not a cloud-native (AWS/GCP/Azure) role.
• Hands-on comfort with datacenter and hardware work (cabling, rack/stack, hardware troubleshooting).

Required skills

• Networking fundamentals: VLANs, routing, firewalls and load balancers.
• Containerization and orchestration (Docker, Kubernetes).
• Git and standard version control workflows.
• Scripting and tooling development.

What we offer

• Salary range of $145,000 to $170,000 annually, depending on qualifications and experience.
• Medical, dental and vision insurance, disability insurance and 401(k).
• Flexible spending account and commuter benefits.
• A location near I-680 and I-880, with public transport and amenities nearby.