Principal Product Manager - M365 Copilot LLM Platform

Microsoft · Washington · $142,800–$274,800 (stated in the posting)

Apply on the company website

The Microsoft 365 Core Copilot Infrastructure team is hiring a Principal Product Manager to be the product owner and architect for the M365 LLM platform that powers Copilot across Microsoft 365. This is not a capacity operations role. We are looking for a technical product leader who can think through the platform end to end: which hardware SKUs we bet on, how we manage and allocate the GPU and CPU fleet, and which optimizations we make at each layer of the stack, and who can turn that thinking into products, roadmaps and decisions. 

AI growth is reshaping the platform. Demand is larger and less predictable than ever, hardware and model choices carry more weight, and the cost of getting them wrong scales with the fleet. You will set the direction for the platform and build intelligent, self-service systems to replace manual, ticket-driven processes. Building agents to optimize outcomes using live constraints, availability and demand, always anchored in what our Copilot customers and partner teams need.

This is an AI-first product management role. You will use agents, automation, and AI-driven analysis alongside standard PM tools to read telemetry, model tradeoffs, prototype solutions, and reach decisions faster. You will translate hard technical and financial tradeoffs into terms leaders can act on, and you will lead the team toward AI-forward ways of working, including evaluation sets and agent-based workflows built into how the work gets done. 

You will partner closely with engineering leaders, architects, data scientists, finance, supply chain, and Copilot scenario teams across Microsoft. The role carries broad visibility and influence, and it depends on strong product sense, technical depth, data fluency, a customer- and partner-facing mindset, and clear judgment under uncertainty. As a senior leader on the team, you will operate independently, act as a true partner to the team's leadership, mentor other product managers, and raise the bar for how the team works. 

This position is based in Redmond, Washington and requires the employee be in the office a minimum of 3 days per week.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

• Own the product vision, strategy, and roadmap for the infrastructure layer of the M365 LLM platform, and turn that direction into plans engineering teams can execute.
• Act as a platform architect: reason end to end across hardware SKU selection, fleet management and allocation, model serving, and optimization opportunities, and drive consistent decisions across all of them.
• Lead the product direction for AI-driven decision systems: agents and automation that recommend how to place, allocate, and transition GPU and CPU capacity based on live constraints, availability, and demand.
• Replace manual, ticket-driven intake and allocation with intelligent, self-service platform capabilities, and measure their adoption and impact.
• Bring a strong customer and partner mindset—partner with Copilot scenario teams and platform partners to understand their needs and translate them into durable platform capabilities and investments.
• Identify and prioritize efficiency and performance optimizations across hardware, serving, and models, weighing cost, performance, and reliability with partners across engineering, finance, and supply chain.
• Advance platform, model, and hardware transition strategy, including bringing new hardware generations and models onto the platform.

Required Qualifications:

• Bachelor's Degree AND 8+ years experience in product/service/program management or software development
  • OR equivalent experience.

Preferred Qualifications:

• Bachelor's Degree AND 12+ years experience in product/service/program management or software development
  • OR equivalent experience.
• 4+ years experience taking a product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework).
• 6+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn).
• 6+ years experience disrupting a market for a product, feature, or experience (e.g., competitive disruption, taking the place of an established competing product).
• Experience as a product owner or architect for large-scale cloud, AI, or distributed systems platforms, with the ability to reason end to end from hardware to service.
• Experience with LLMs, model-serving platforms, GPU infrastructure, or large-scale AI-powered products.
• Track record of building AI-driven or automated products that replace manual operational processes.
• Experience taking on ambiguous, high-stakes work and driving it independently from strategy through execution across organizations. 
• Proven ability to think at the platform level while keeping a strong customer mindset—translating customer and partner needs into durable platform capabilities.
• Experience leading large-scale cloud infrastructure, capacity planning, or distributed systems work, with grasp of hyperscale service delivery.
• Experience with LLMs, model-serving platforms, GPU capacity planning, or large-scale AI-powered products.
• AI fluency, including using AI agents, automation, and prototyping to speed up analysis, decisions, and product work.
• Experience using telemetry, demand signals, and operational data to guide platform and investment decisions.
• Experience mentoring and developing product managers and technical leaders.
• Systems-level problem solving and clear communication, with the ability to influence senior leaders and align stakeholders across organizations.

Product Management IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

More jobs at Microsoft · Product jobs in Washington DC