AI Infrastructure Engineer (Senior/Staff) at Recruiting from Scratch · San Francisco, CA · Joined
RS
AI Infrastructure Engineer (Senior/Staff)
Recruiting from Scratch · San Francisco, CA · Just now · 0 applicants
NewOn-siteFull-timeLead
Pay
$200k–$400kListed
Workplace
On-site
Job type
Full-time
Level
Lead
Team: GPU platform team · Source: jobright · Posted by joined-scrapper
About the role
Senior/Staff engineer role on an AI infrastructure company's GPU platform team, owning design and operation of production GPU clusters, schedulers, distributed training, LLM serving, and fleet health systems.
What you’ll do
Design and operate GPU clusters
Build and maintain schedulers
Develop distributed training infrastructure
Operate LLM serving stacks
Manage fleet health systems
Participate in on-call rotation
What you’ll need
5+ years building and operating production distributed systems or ML infra (7+ for Staff)
Ran GPU workloads at real production scale
Owned a GPU cluster/scheduler, distributed training infrastructure, or LLM serving stack
Production Python plus Go or C++
Deep Kubernetes and working Slurm or other HPC resource manager
One major cloud in depth; comfortable on-call and still writes code
Original job description
Recruiting from Scratch is representing an unnamed AI infrastructure company hiring an engineer for its GPU platform team. The role designs and operates GPU clusters, schedulers, distributed training infrastructure, LLM serving, and fleet health systems.5+ years building and operating production distributed systems or ML infra (7+ for Staff), counted from…