Experimental Mind: one thousand

This is newsletter number 140 and for the first time it goes out to more than one thousand subscribers! At the beginning of 2022 I was expecting to reach this number somewhere this year, but it happened much quicker than expected. Thanks to everyone that has been recommending other people to subscribe.

Did you recently subscribe? Welcome to the club of one thousand Experimental Minds!


🔎 What I’ve been reading

The fine art of visualizing experiment results

Allen Chang from the Disney Streaming Experimentation team, explains how they use data visualisation in their experimentation platform to present results.

How to choose a privacy compliant A/B testing tool
If you’re searching for an A/B testing tool, it’s important that the solution be compliant with German and EU data privacy laws. Here are some factors to consider when choosing a platform.

Experimentation Culture Awards 2022
Experimentation Culture Awards 2022experimentationcultureawards.com

I’ll be one of the jury members at the 2022 Experimentation Culture Awards. Submit your case before May 14th, 8pm UTC.

How to form realistic expectations about data

In part three of this blog post serie where Cassie Kozyrkov shares the differences between an amateur and a professional analyst, she sets some realistic expectations on the role of an analyst.

You often need to start with bad data to figure out how to make better data.

Professionals know that just because you have a spreadsheet full of numbers doesn’t guarantee that you’ll be able to get anything useful out of it. But they’ll step up and help you design a way to do better next time.

This guy tracks everything: "Why I put my whole life into a single database"

Back in 2019, Felix Krause started collecting all kinds of metrics about my life. Every single day for the last 2.5 years he tracked over 100 different data types – ranging from fitness & nutrition to social life, computer usage and weather.

Virtual communication curbs creative idea generation

This is an interesting study on the impact of remote work on idea generation. The researchers performed a laboratory study and in a field experiment across five countries. They randomly assigned pairs to generate and evaluate their ideas either on video or in-person.

We find that videoconferencing pairs generate fewer creative ideas than in-person pairs.

but also …

We find that virtual groups are at least, if not more, effective than in-person pairs when it comes to selecting the best idea.

🚀 Job opportunities

All featured roles:

Also checkout the job board for more open roles in the field of experimentation, CRO and analytics.

📅 Upcoming events

Upcoming events in the next months:

See the full overview of events to find 15+ other events and conferences for you and your team.

💬 Quote of the week

“I believe every business is an experiment. For the experiment to succeed, you need to test your hypothesis, measure the results, and follow where they lead.” — Reid Hoffman (source)

😉 Fun of the week

Do you have a North Star Metric for your family?

[tweet https://twitter.com/stephanie_leue/status/1519929802379218945]

☕ Thanks for reading

If you’re enjoying the Experimental Mind newsletter and want to say thank you? Buy me a coffee (or a beer). Or share this newsletter with a friend or colleague.

Have a great week — and keep experimenting.

Kevin