Principal Technical Program Manager (TPM) - AI Infrastructure Operations

Nscale — New York, New York, United States · Remote · Staff+

Apply for this role

Role description

Role Overview

As a Technical Program Manager (TPM) for AI Infrastructure Operations, you will be responsible for driving complex, cross-functional programs that ensure the stability, availability, and growth of our cutting-edge GPU fleet and Infiniband network fabrics. This role requires a blend of deep technical understanding, rigorous program management, and a relentless focus on delivering against key operational metrics (SLAs, Uptime, Availability). You will bridge the gap between engineering execution and strategic business goals, directly impacting our ability to serve customer workloads at scale.

What You Will Do

Program Leadership: Own the planning, execution, and delivery of strategic operational programs, including new data center AI infrastructure build-outs, large-scale fleet software/firmware rollouts, and the implementation of new operational tooling (in partnership with SRE). Metrics and Reporting: Establish, track, and drive accountability against critical infrastructure KPIs, specifically focusing on Availability (Target 97.5%) and Uptime (Target 99%). Process Engineering: Analyze and optimize operational workflows across Fleet Operations, Network Operations, and SRE teams.

Why It Might Be a Fit

We're looking for a highly skilled Technical Program Manager to join our team. If you have experience in a Technical Program Management role, successfully driving large-scale, complex infrastructure or software engineering programs, and a strong foundational understanding of data center infrastructure, distributed systems, Linux, and networking concepts, this could be the perfect fit for you.

Requirements

  • 5+ years of experience in a Technical Program Management role
  • Strong foundational understanding of data center infrastructure, distributed systems, Linux, and networking concepts
  • Proven expertise in modern program management methodologies (Agile, Scrum, PMP certification preferred)
  • Exceptional organizational, communication, and presentation skills
  • Demonstrable experience in defining, tracking, and improving system performance based on operational metrics (e.g., Uptime, Availability, MTTR, SLOs/SLIs)
  • Ability to thrive in a fast-paced, high-growth environment, managing multiple priorities and adapting to evolving technical requirements

Benefits

  • Highly competitive package (base + equity) with reviews every 12 months
  • Dynamic progression plan tailored to your ambitions
  • Collaborative, supportive, and innovative environment
  • Chance to push boundaries, collaborate with brilliant minds, and make your mark on cutting-edge AI

More jobs at Nscale

Canonical job page

More roles at Nscale