Group Product Manager - Inference and Token Factory

JOB INFO

Apply

Apply for this job directly on SHORTList.

Referral

Share your custom referral link for this job with qualified candidates. Earn the referral you lead to a hire.

COMPANYVolta
BASE SALARY$255k – $330k+ Equity

The Group Product Manager, Inference and Token Factory, owns product strategy for Volta's inference infrastructure — the systems that serve models efficiently at scale and turn compute into tokens, reliably and cost-effectively. You will lead a team of product managers focused on inference performance, efficiency, and the token-serving infrastructure that underpins AI workloads.

What You Will Be Doing:

  • Own product strategy and roadmap for inference infrastructure and token-serving capabilities
  • Lead and develop a team of product managers focused on inference and serving infrastructure
  • Partner with platform engineering to define features that improve inference throughput, latency, and cost efficiency
  • Track industry and customer trends in inference workloads and translate them into roadmap priorities
  • Define and monitor metrics for inference performance and efficiency
  • Represent inference and token-serving priorities in cross-functional and leadership planning
  • Work with key customers to understand evolving inference needs

What You Bring:

  • Significant product management experience in AI/ML infrastructure or inference serving is essential
  • Experience managing other product managers or leading a product team
  • Strong technical understanding of model serving, inference optimization, or GPU compute
  • A track record shipping infrastructure products in a fast-evolving technical space
  • Excellent prioritization and cross-functional communication skills

What We Offer:

  • Competitive salary based on the work you do here, not your previous salary
  • Equity in Volta, giving you the opportunity to share in the company's long-term success
  • Retirement/pension contributions
  • Comprehensive health, wellbeing and insurance benefits
  • Generous number of vacation days each year