10:20 - 11:20
Talk (60 min)
Overcoming A/B testing challenges and pitfalls
This sessions is going to give an overview of what A/B testing is. I will cover how to work with cross-functional partners to set up a test and analyse it.
Finally, I will talk about how to make a decision based on the test results. I will go into depth about the most common challenges and pitfalls that I have experienced throughout my career and how to avoid making the most common mistakes. After the talk, you will know what to do when someone asks you to analyse an experiment you haven't designed, how to deal with partners asking for 'directional data' and how to work successfully with engineering to ensure each test is set up correctly.