GXP (Global Experience Platform) is at the heart of Microsoft’s transformation to an AI-Native company, creating products where intelligence is foundational, not added on. As a Senior Applied Scientist, you will work at the intersection of research and product, leveraging cutting-edge AI to deliver transformative experiences for millions of users. You will play a critical role in the areas of Large Language Model (LLM), Prompt Engineering, Context Engineering, Metrics and Evaluation, responsible for developing an end-to-end infrastructure and measurement framework, fostering cross-functional collaboration, and leveraging data science and AI expertise to guide decision-making. We seek candidates passionate about large language models (LLMs), AI-powered applications, and data-driven innovation.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
- Build benchmarks, evaluation datasets, metrics, and methods to assess and improve the performance and effectiveness of language models and prompts and drive iterative enhancements.
- Deliver high-impact analyses that generate actionable insights to steer product and business decisions and improve user satisfaction.
- Collaborate closely with engineering, research, product, and other teams to ensure AI-driven experiences meet quality and user experience standards.
- Analyze latest AI innovations and explore opportunities to apply cutting-edge techniques for building scalable, high-impact solutions that enhance product capabilities and deliver exceptional user experiences.
Qualifications
Required Qualifications:
-
Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)
- OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
- OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
- OR equivalent experience.
-
Hands-on experience with Large Language (LLMs), including evaluation techniques, prompt engineering, model fine-tuning.
-
3+ years of experience in applied science or machine learning, natural language processing (NLP), or AI systems.
- Proficiency in Python, C#, or similar languages.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications:
- Exceptional analytical and problem-solving skills with a track record of tacking complex challenges.
-
Solid communication and presentation abilities, capable of conveying technical concepts to diverse audiences.
-
Proven experience across the product lifecycle from ideation to shipping.
- Publications in leading AI/ML conferences (e.g., NeurIPS, ICML, ACL), demonstrating thought leadership and technical depth.