Microsoft's Experimentation Platform

Accelerating software innovation through trustworthy experimentation

Home
Contact Us
Cool Things about Microsoft
ExP Articles
ExP Talks & Presentations
ExP Tools
What's a HiPPO?
Online Controlled Experiments: Listening to the Customers, not to the HiPPO
 
Similar, slightly longer, keynote at EC10: PPTX
 
Agenda
  • Controlled Experiments in one slide
  • Examples: you’re the decision maker
  • Cultural evolution: hubris, insight through measurement, Semmelweis reflex, fundamental understanding

Two key messages to remember

  • It is hard to assess the value of ideas. Get the data by experimenting because data trumps intuition
  • Make sure the org agrees what you are optimizing and evolve your culture towards data-driven decisions
 
Referrers: