Enable America Jobs

At the core of the M365 Core organization’s strategy is to build your copilot for work, combining the power of AI with your data in the Microsoft Graph and the Microsoft 365 apps to turn your words into the most powerful productivity tool on the planet.  

The M365 Copilot Infrastructure team owns the entire infrastructure to power all M365 AI Copilots including and beyond BizChat (Word/Excel/PowerPoint Copilots, Teams Meeting Copilot and more). We enable M365 teams to access OpenAI models and other language models meeting the needs of enterprise grade compliance and operate one of the largest LLM GPU fleets in the world. You will be part of an organization that brings together talent in the areas of AI model deployment and inference, small and large language models, GPU cluster management, and continuous infrastructure optimization. If you are looking for opportunities at the forefront of the exciting AI revolution at Microsoft and want to work in the deep core of Generative AI infrastructure, hosting state-of-art Large Language Models with one of the most advanced GPU fleets on the planet, then read on.  

The role:  

We are looking for an experienced Senior Product Manager who can apply a product mindset with a proven track record of shipping AI infrastructure for planet-scale applications. As a Senior Product Manager on this team, you will have a unique opportunity to work in an exciting and fast-paced environment, collaborating closely with teams across the company. You will be part of an organization that brings together talent in the areas of AI model deployment and inference, small and large language models, GPU cluster management, and continuous infrastructure optimization.  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Define the strategy and roadmap for M365 AI Inferencing infrastructure by partnering with all enterprise productivity teams to understand their usage scenarios, pain points and needs. 

• Design and deliver new capabilities of M365 AI inferencing infrastructure to enable state-of-art AI models deployed to production environment for all M365 users across Enterprise and Consumer, worldwide and sovereign clouds.  

• Lead the team to continuously improve AI inferencing infrastructure efficiency and reduce infrastructure cost.  

• Define, measure and report product success metrics for M365 AI inferencing infrastructure.   

• Provide subject matter expertise to internal engineering groups and product teams with understanding of various Compliance obligations in AI inferencing and working with them to develop roadmaps to achieve Compliance requirements. 

Qualifications

Required Qualifications:  

• 5+ years of product experience. 

• BS/BA degree, MS preferred in Computer Science, Engineering, or related technical field. 

• Experience building products across large scale platform/ecosystem, or marketplaces.  

• Understanding of LLM and AI technologies, data analytics and processing systems, and quality evaluation systems. 

Preferred Qualifications:  

• Proven Ability to understand business needs and translate them into technical capabilities that align with product vision and strategy. 

• Excellent collaborator who can work effectively across teams and organizations in matrixed environments and build trust and rapport with stakeholders. 

• Demonstrated experience in developing AI Inferencing infrastructure. 

• Adaptable and resilient in handling ambiguity and rapid change, and skilled in using experimentation and customer studies to validate assumptions and learn from feedback. 

• Clear and persuasive communicator who can tailor messages for both technical and non-technical audiences, and articulate product value and vision.  

• Enthusiastic and inquisitive about small and large language models and their impact on the future of artificial intelligence and software products. 

• Team player who is confident, independent, and enthusiastic, and who can inspire and motivate others. 

#M365CORE

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .