Experimental Mind: stop confusing correlation with causation

Hey friends,

Welcome to a new week, and to a new Experimental Mind newsletter. In this edition I have 5 articles, 2 new events and 16 job opportunities (including one where we can work together, remotely).

All links are freshly picked and curated by me, so you don’t have to. Enjoy!

ps. I like to hear what you think of this newsletter, Share your feedback, it takes less than a minute. 🙏


🔎 What I’ve been reading this week

1. Stop confusing correlation with causation

According to Michael Luca …

We must learn to analyze data and assess causal claims — a skill that is increasingly important for business and government leaders. One way to accomplish this is by emphasizing the value of experiments in organizations.

2. CRO vs. CXO vs. Experimentation

Ben Labay shared his framework for defining and differentiating between CRO, CXO, and experimentation:

“… this can be our industry’s new language. So whether you’re in marketing, product, sales, or ‘growth’, or you’re the CEO or COO, you have a common language, understanding, and expectations relevant to the flavor of the discipline you implement.”

3. Data Quality: Fundamental building blocks for trustworthy A/B testing analysis

In this blogpost the Microsoft experimentation team explains several signs of data quality issues in A/B testing and how to monitor those.

4. Accelerating innovation with A/B Testing

Master the art of A/B testing with Ronny Kohavi. He will be hosting a series of 5 two hour long sessions, especially for executives who want to make their organizations data-driven.

5. Mistakes in Optimizely stats documentation

Ronny Kohavi roasts Optimizely’s (and Adobe) documentation. They are misinterpreting p-values.

🚀 Job opportunities

Are you looking for a new opportunity? These are this weeks featured jobs:

Or have a look at the 16 other open roles on the job board.

Are you hiring? Post your open roles to the job board. Readers of this newsletters can post for free, by using this coupon code at the last step: SUBSCRIBER200

📅 Upcoming events

This is a running list of upcoming events:

💬 Quote of the week

“You never change things by fighting the existing reality. To change something, build a new model that makes the existing model obsolete.” — R. Buckminster Fuller

😉 Fun of the week

Visit Iceland mocks Mark Zuckerberg about his Metaverse and presents the ‘Icelandverse’:

The Icelandverse is unlike any other open-world experience with “-verse” in name, because it’s real. Plus, you don’t need a funny-looking VR headset.

🔁 Any feedback?

Don’t forget to share your feedback, it takes less than a minute.

🙏 Thanks for reading

If you’re enjoying the Experimental Mind newsletter you can buy me a coffee or beer. Thanks to the 10 people who already did it. Much appreciated.

And share this email with a friend or colleague. I would love this community of experimenters to grow. You can point them here to subscribe.

Have a great week — and keep experimenting.

Kevin