Back to Jobs

[Remote] Product Manager, Cloud

Remote, USA Full-time Posted 2026-06-21

Note: The job is a remote job and is open to candidates in USA. Modular is on a mission to revolutionize AI infrastructure by rebuilding the AI software stack. They are seeking a Product Manager to drive the product vision for their cloud compute platform, collaborating closely with engineering and partners to create a high-performance AI model-serving system.

Responsibilities

  • Own the product vision and strategy for Modular’s Cloud Platform, grounded in real customer workloads and measurable business outcomes
  • Partner with engineering and leading AI application teams to design and deliver a high-performance, transparent AI serving platform, giving customers deep visibility and control over performance, cost, and execution
  • Define and manage roadmaps, milestones, and success metrics, balancing near-term delivery with long-term platform evolution
  • Drive customer- and data-informed prioritization, translating market signals, performance insights, and feedback into clear product decisions and trade-offs
  • Work cross-functionally with engineering, program management, technical writing, design, and GTM to deliver a cohesive end-to-end cloud product experience
  • Engage directly with advanced enterprise customers and partners to validate direction, support early deployments, and feed learnings back into the platform
  • Identify and advance strategic integrations across hardware, cloud, and ecosystem partners while preserving performance and programmability as first-class principles

Skills

  • 9+ years of product management experience, including significant work on technical cloud platforms, AI infrastructure, or data systems, or equivalent experience as a software or AI systems engineer
  • Strong understanding of cloud architectures and technologies (e.g., Kubernetes), and/or experience with AI infrastructure platforms such as PyTorch, vLLM, CUDA, Vertex AI, SageMaker, or similar systems
  • Experience defining product vision, shaping roadmap trade-offs, and driving products from early adoption toward broader production use
  • Familiarity with security, privacy, and compliance considerations for cloud platforms
  • Strong analytical and systems-level thinking, with the ability to reason about performance, scalability, and cost
  • Excellent written and verbal communication skills, especially when working across technical and non-technical audiences
  • A growth-oriented mindset with a bias toward learning from customers, data, and real-world usage
  • Master's degree or Ph.D. in Computer Science or related technical field
  • Experience developing, training, and/or deploying machine learning models into production environments
  • Have worked in or around startups before or have a strong understanding of the nature of fast-moving, highly dynamic teams

Benefits

  • Premier insurance plans
  • Up to 5% 401k matching
  • Flexible paid time off
  • Stock options
  • Team Building Events
  • Regular team onsites and local meetups in Los Altos, CA as well as different cities
  • Traveling 2-4 times a year is expected for all roles

Company Overview

  • Modular provides AI infrastructure for deployment, serving, and programming GPUs. It was founded in 2022, and is headquartered in Palo Alto, California, USA, with a workforce of 51-200 employees. Its website is https://www.modular.com.
  • Company H1B Sponsorship

  • Modular has a track record of offering H1B sponsorships, with 3 in 2026, 10 in 2025, 6 in 2024, 8 in 2023, 4 in 2022. Please note that this does not guarantee sponsorship for this specific role.
  • Apply To This Job

    Similar Jobs

    [Remote] Semiconductor Software Engineer

    Remote, USA Full-time

    [Remote] Sitecore Engineer, Lead Consultant- Remote

    Remote, USA Full-time

    [Remote] Licensed Civil Engineer - Data Center

    Remote, USA Full-time

    [Remote] Staff Software Engineer

    Remote, USA Full-time

    [Remote] Privacy Associate Analyst

    Remote, USA Full-time

    [Remote] Mid Market Account Executive - Remote California (Future Opportunities)

    Remote, USA Full-time

    [Remote] Fully Remote Entry Level Sales ($75,000 - $175,000)

    Remote, USA Full-time

    [Remote] Senior Product Designer

    Remote, USA Full-time

    [Remote] Solution Consultant US

    Remote, USA Full-time

    [Remote] Senior Enterprise Systems Product Manager

    Remote, USA Full-time

    Experienced Data Entry Specialist – Remote Opportunity for Detail-Oriented Individuals to Join arenaflex Team

    Remote, USA Full-time

    Lead Rust Software Engineer – Capital One Software (Remote)

    Remote, USA Full-time

    Experienced Patient Advocate Representative – Delivering Exceptional Customer Service in a Dynamic Call Center Environment at arenaflex

    Remote, USA Full-time

    Senior Medical Writer - Medical Information

    Remote, USA Full-time

    Experienced Entry-Level Data Entry Specialist – Kickstart Your Career at arenaflex

    Remote, USA Full-time

    Need Teacher - Music - Vocal in USA

    Remote, USA Full-time

    Youth Ministries Development Coordinator

    Remote, USA Full-time

    Experienced Virtual Data Entry Specialist – Flexible Remote Work Opportunity at arenaflex

    Remote, USA Full-time

    Research Associate (Per Diem)

    Remote, USA Full-time

    Experienced Customer Success Manager II | EMEA – Unlock Global Opportunity for Every Person, Team, and Business

    Remote, USA Full-time