Online Controlled Experiments: Listening to the Customers, not to the HiPPO
Similar, slightly longer, keynote at EC10: PPTX
Agenda
Controlled Experiments in one slide
Examples: you’re the decision maker
Cultural evolution: hubris, insight through measurement, Semmelweis reflex, fundamental understanding
Two key messages to remember
It is hard to assess the value of ideas. Get the data by experimenting because data trumps intuition
Make sure the org agrees what you are optimizing and evolve your culture towards data-driven decisions
Referrers: