Experimental Mind: False Positives, Overlapping Experiments, Anecdotal Evidence, Task Playbooks …

Hey friends,

In this Experimental Mind newsletter 5 articles, 18 job opportunities and 9 events. As always: everything is handpicked and in one easy digestible email, so you can focus on running your experiments. Enjoy.

πŸ“° What I’ve been reading this week

1. Interpreting A/B test results: false positives and statistical significance
1. Interpreting A/B test results: false positives and statistical significance β€” netflixtechblog.com

This is the third post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products.

2. Embracing overlapping A/B Tests

Timothy Chan explains how to best deal with overlapping experiments.

Interaction effects are often overblown

3. Designing experiments with new ways of working

John Cutler’s advice:

[tweet https://twitter.com/johncutlefish/status/1447086449573052421]

4. Seth Godin: β€œWhat evidence would you need to see to change your mind?”

The honest answer to this question is usually: β€œI need a new story that’s more immediate, more vivid and most of all, more culturally aligned than the one I have now.” … An anecdote is not evidence. But we often treat it that way.

5. CXL launches playbooks

This is the opposite of a full course, playbooks are bit-sized explainers on how to accomplish a specific task.

Just-in-time learning is focused on meeting the learner’s need when it arises, rather than pre-scheduled education sessions that occur regardless of the immediacy or scope of need.

πŸš€ Job opportunities

This week’s featured jobs: 

Or have a look at the 13 other opportunities on the job board.

πŸ“… Upcoming events

This is a running list of upcoming events:

πŸ’¬ Quote of the week

“Progress is more important than perfection.” β€” Simon Sinek

πŸ˜‰ Fun of the week

What if companies/Apps decided to sell you cookies? Yassine Chouk imagined the results for you.

click image for high res images

πŸ” Any feedback?

Do you have a minute to give me some feedback on this newsletter?

πŸ™ Thanks for reading

If you’re enjoying the Experimental Mind newsletter you can buy me a coffee or beer. Thanks to the 5 people who already did it. Much appreciated.

And share this email with a friend or colleague. I would love this community of experimenters to grow. You can point them here to subscribe.

Have a great week β€” and keep experimenting.