Product Manager, AI Infrastructure

JOB INFO

Apply

Apply for this job directly on SHORTList.

Referral

Share your custom referral link for this job with qualified candidates. Earn the referral you lead to a hire.

BASE SALARY$175k – $220k+ Equity

Responsibilities

  • Own the day-to-day product and feature work across Together's AI infrastructure products - GPU Clusters, Managed Storage, and observability - with an early focus on observability and storage.
  • Find and drive problems to resolution with minimal guidance, including issues that aren't yet on anyone's radar.
  • Run structured, hypothesis-driven experiments - reading the data yourself and driving the data collection and instrumentation needed to answer open questions.
  • Partner across engineering, product, and partner teams to ship improvements and unblock work without waiting for permission.
  • Translate a deep understanding of customers operating in fast-moving, high-ambiguity markets into product decisions.
  • Juggle multiple priorities and workstreams across a broad infrastructure surface.
  • Grow into end-to-end ownership of a complete product area (observability or storage) as you ramp.

Requirements

  • Deep empathy for customers operating in high-ambiguity, fast-evolving markets; we work with AI Native startups and model labs that move at high pace
  • Strong, hands-on data and analytics skills with a hypothesis-driven approach - you design experiments, read the data yourself, and can drive the data collection needed to get answers.
  • High agency: you find problems, push through resistance, and drive resolution without waiting to be told what to do.
  • A real technical foundation -whether from an AI/infrastructure background, hands-on software development, or strong working knowledge of cloud and infrastructure.
  • A track record of collaborating across orgs and product lines to get things done.
  • Comfortable managing multiple priorities and workstreams at once.
  • Familiarity with the AI stack, especially at the infrastructure layer, is a strong plus.
  • Cloud platform experience (AWS, Azure, GCP, or similar) - with extra weight if you've helped build such products.
  • Bonus: working knowledge of the Nvidia/AMD GPU stack (InfiniBand, NCCL, GPU operator, etc.), or experience with AI training or inference workloads.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $ 175,000 - 220,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.