Senior Software Engineer
Microsoft Corporation
Multiple Locations, Multiple Locations
Job posting number: #7318734 (Ref:ms-1894693)
Posted: October 20, 2025
Job Description
Come build the core of Microsoft Copilot for enterprise with Microsoft Turing Team, where you'll join a collaborative group of applied scientists and engineers pushing the frontier of large language models (LLMs) to improve the productivity of hundreds of millions of users around the world.
Our team is responsible for the core systems that power Microsoft 365 Copilot Chat delivering intelligence, quality, and transformative new features. We work at the intersection of research and engineering—advancing orchestrator reasoning, training next-generation models, and shipping impactful, model-driven experiences in Microsoft 365 Copilot.
Shape the way the world measures and trusts AI. In the Experimentation & Evaluation area, you’ll define what “good” means for Copilot, by working on metrics, scorecards and eval pipelines across offline, shadow, and online experiments. You’ll work at the intersection of science and engineering, gaining a front-row seat to how AI impacts millions of users and help steer one of Microsoft’s most important products forward.
As a Senior Software Engineer in the Experimentation & Evaluation area, you will build pipelines that power Copilot’s measurement and experimentation. You will design reliable systems for offline, shadow, and online scorecards, enabling fast and trustworthy evaluation of AI models and features. Through scalable engineering, you will turn complex data into actionable insights that accelerate Copilot’s innovation and impact.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond
Our team is responsible for the core systems that power Microsoft 365 Copilot Chat delivering intelligence, quality, and transformative new features. We work at the intersection of research and engineering—advancing orchestrator reasoning, training next-generation models, and shipping impactful, model-driven experiences in Microsoft 365 Copilot.
Shape the way the world measures and trusts AI. In the Experimentation & Evaluation area, you’ll define what “good” means for Copilot, by working on metrics, scorecards and eval pipelines across offline, shadow, and online experiments. You’ll work at the intersection of science and engineering, gaining a front-row seat to how AI impacts millions of users and help steer one of Microsoft’s most important products forward.
As a Senior Software Engineer in the Experimentation & Evaluation area, you will build pipelines that power Copilot’s measurement and experimentation. You will design reliable systems for offline, shadow, and online scorecards, enabling fast and trustworthy evaluation of AI models and features. Through scalable engineering, you will turn complex data into actionable insights that accelerate Copilot’s innovation and impact.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond
Apply Now
Please mention to the employer that you saw this ad on AmericanCareers.com
- Share this job:
- [Save this Job]
