# Software Engineer – ML Infrastructure at People Culture Talent

People Culture Talent · San Francisco, on-site · $150k–$350k

Posted 11 Nov 2026 · Still open at our check on 14 Nov 2026

## At a glance

- Role: DevOps and platform · Senior
- Where you work: San Francisco, United States · in the office
- Pay: $150k–$350k, as stated
- Skills: ML infrastructure, Distributed systems, Distributed training, PyTorch (core); ML inference, GPU, Observability, Reinforcement learning, Model evaluation, Rlhf
- Help me apply: https://roleford.com/signin?job=1886cb7f5534478b3a29599e9981f2688796042b&from=%2Fjob%2Fsoftware-engineer-ml-infrastructure-people-culture-talent-1886cb7f5534

## The job, as People Culture Talent posted it

The full text from the original posting, checked 14 Nov 2026.

Note: We are recruiting on behalf of our valued client. This opportunity is for a position with their organization, not with People Culture Talent. We're excited to help connect talented professionals with this exceptional team!

### The Role

We’re seeking an experienced ML Infrastructure Software Engineer to build and improve infrastructure for machine learning workloads. You’ll partner with researchers and engineers to support experimentation, training, evaluation, and production deployment, with a focus on reliability and performance.

### What You’ll Own

- Design and build infrastructure for model training and production serving.
- Develop reliable pipelines and shared tools that help teams run and manage machine learning workloads.
- Improve compute utilization, workload scheduling, and performance across distributed systems.
- Use profiling and monitoring to identify bottlenecks, troubleshoot failures, and guide improvements.
- Automate testing and measurement to help teams assess changes consistently.
- Lead architectural decisions, explain trade-offs, and carry projects from initial design through deployment and ongoing operation.
- Collaborate with researchers and engineering teams to turn evolving requirements into maintainable systems.

### What You’ll Bring

- Substantial software engineering experience with technical ownership at Senior Engineer level or equivalent.
- A track record of personally designing, building, and operating core machine learning infrastructure.
- Hands-on experience with PyTorch, model serving engines, and distributed training frameworks
- Strong experience with distributed systems and large-scale compute environments, including GPU-based workloads.
- Solid background in reinforcement learning (RL) post-training infrastructure, RLHF, or automated model evaluation pipelines
- Practical experience with modern machine learning frameworks and their supporting infrastructure.
- Strong systems design, debugging, and performance optimization skills.
- Clear, concise communication and the ability to explain your contributions, architectural choices, and technical trade-offs.
- Experience owning systems over time, including maintenance, reliability, and improvements as requirements evolve.

### Preferred experience

- Experience supporting both training infrastructure and production model deployment.
- Experience with large language model workloads is a plus, but not required. Infrastructure experience with other types of machine learning models is equally relevant.

Roleford is not the employer and doesn't take part in hiring decisions.

## Similar jobs

- [Sr. Director, DevOps at Veeam Software](https://roleford.com/job/sr-director-devops-veeam-software-72cffee1432e): San Jose, on-site · $424.8k–$882.2k · 11 Nov
- [Principal Software Development Engineer at ZScaler](https://roleford.com/job/principal-software-development-engineer-zscaler-d86ec5d27e8b): Santa Clara, on-site · $185k–$265k · 11 Nov
- [Member of Technical Staff, Developer Productivity at Parallel](https://roleford.com/job/member-of-technical-staff-developer-productivity-parallel-ad5b8a714420): San Francisco, on-site · $150k–$300k · 11 Nov
- [Member of Technical Staff - ML Infrastructure Engineer, RL Post-training at Preference Model](https://roleford.com/job/member-of-technical-staff-ml-infrastructure-engineer-rl-post-training-preference-77cfdc9ae735): San Francisco, on-site · $200k–$350k · 11 Nov
- [Senior Systems Engineer I at Elsevier](https://roleford.com/job/senior-systems-engineer-i-elsevier-0573468b8138): United States, on-site · $78.8k–$131.3k · 11 Nov

## Reusing this page

The job text belongs to People Culture Talent. Roleford's parts (At a glance, similar jobs) may be quoted with a visible link to https://roleford.com/job/software-engineer-ml-infrastructure-people-culture-talent-1886cb7f5534. Rules: https://roleford.com/reuse