Skip to content

The weekly data engineering newsletter. Pick your topics, keep your reads.

dataaaaa!

CoreWeave · Posted 1d ago

Staff Product Manager (AI Inference)

$207–275K/yrLead / manager

Job relayed by Stapply Data, its source: you apply there.

Location
🇺🇸 Sunnyvale, United States
Contract
Full-time
Role
Data science
Source
Stapply Data

Stack

  • LLM
  • Kubernetes

The posting

Join CoreWeave as a Staff Product Manager - AI Inference. In this role, you will lead the development of cutting-edge AI inference services, collaborating with engineers, designers, and industry partners. You will define the product vision, roadmap, and go-to-market strategy, while staying current on advancements in AI/ML technologies. The ideal candidate has a deep understanding of AI/ML workloads, cloud infrastructure, and a proven track record in product management.

- Définir la vision du produit, la feuille de route et la stratégie de mise sur le marché pour les services d'inférence AI. - Posséder la feuille de route du produit pour les services d'inférence AI, en équilibrant les besoins des clients à court terme avec la vision à long terme. - Collaborer avec les clients clés pour comprendre leurs charges de travail AI, leurs points de douleur et leurs exigences futures.

- The ideal candidate is passionate about AI and cloud technologies, with a deep understanding of the foundation model architectures, AI inference landscape, AI application ecosystem, cloud-native technologies, and the competitive landscape - Customer-Centric Approach: Demonstrated experience working closely with customers to identify needs and translate them into product features and solutions - Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field. MBA or equivalent experience is a plus - Communication Skills: Excellent verbal and written communication skills with the ability to influence cross-functional teams and stakeholders - Technical Knowledge: Hands on practitioner and deep understanding of AI/ML workloads including foundation model inference, inference engines such as vllm, SGLang, TensorRT-llm, and llm-d, inference optimization techniques such as quantization and speculative decoding, cloud infrastructure (GPUs), and cloud-native architectures (Kubernetes, microservices) - Experience: 8+ years of experience in product management, with at least 5 years in the cloud services or AI/ML market segment - Results-Oriented: Proven track record of driving business growth through innovative product solutions in the AI and cloud space - Leadership: Proven ability to lead cross functional teams, with strong decision-making, project management, and mentoring skills - Visionary Leadership: Ability to think strategically while being able to dive into technical details to guide the product team