Advanced Topics in Experimentation

These are documents with advanced topics, which we'd love to get feedback on.
They will be part of an upcoming book that I am co-authoring.

The read-only version is easily accessible.
For a read-write version, you'll have to modify the URLs below for getting a read-write version, something easy for most mature adults to do.
The read-write version will allow you to directly add comments.  We would love to acknowledge you, so please either login to your Microsoft Account, or preface your comment with your name.

  1. The Overall Evaluation Criterion (OEC): View
    Feedback (Read/write copy): https://1drv.@@/w/s!AuRxCGEOCRKGkZxD99SELyllXCiySg - replace the @@ with ms
  2. Guardrail Metrics: view
    Feedback (Read/write copy): https://1@@@.ms/w/s!AuRxCGEOCRKGkaNLeYEKx0Ow454ATw - replace the @@@ with drv
  3. Speed Matters: A Slowdown Experiment: view
    Feedback: https://@@@@.ms/w/s!AuRxCGEOCRKGkbtom_KqbZM4YnmD5w - replace the @@@@ with 1drv
  4. Triggering view
    Feedback: https://@@@@.ms/w/s!AuRxCGEOCRKGkcUogtXzo0cJvUizxA - replace the @@@@ with 1drv
  5. The A/A Test: view 
    Feedback: https://@@@@.ms/w/s!AuRxCGEOCRKGkdA72c51id_hD0PGTg - replace the @@@@ with 1drv
  6. Refuted Causal Claims from Observational Studies: view
    Feedback: https://@@@@.ms/w/s!AuRxCGEOCRKGk895qO2oOBy9lCfjqg - replace @@@@ with 1drv
  7. Best Controlled Experiments (which I believe are trustworthy): view
    Feedback: https://@@@@.ms//w/s!AuRxCGEOCRKGk-J_zrPR81Gd9S-ieA - replace @@@@ with 1drv

 

-- Ronny Kohavi