Experimental Mind: Analyzing Tests, Better Programs, Integrated Platforms, Evidently …

Hi everyone,

First of all a warm welcome to the 7 new subscribers. This newsletter keeps growing because many of you forward it to others. Thank you.

This week I will be joining the virtual Etsy Experimentation Event. Let me know if you are also participating.

For the newsletter, I have selected 7 articles, added 1 event and 25 job opportunities.

Check it out ๐Ÿ‘‡


๐Ÿ”Ž What I’ve been reading this week

1. The new standard for planning and analyzing A/B tests

Georgi Georgev did a major overhaul of AnalyticsToolkit.com. This website has solutions to many of the hard questions facing practitioners when planning and analyzing A/B tests.

2. Course: Experimentation program management

New CXL course by Ben Labay on experimentation program management. So in case your experimentation program can use a big push, consider this course. You will get a clear understanding of the pillars of experimentation programs and how to scale them to your needs.

3. Podcast: Modern experimentation platforms

Che Sharma (owner of Eppo) talks about how seamless end-to-end experimentation workflows supercharge product development.

4. Data product roles require specialization

The role of data product manager is becoming more popular. Eric Weber explains why specific background in data is necessary for this role.

5. Defining the applied behavioral scientist role

Connor Joyce created a framework with pillars of the role of a appliced behavioral scientist. There three main components:

  1. Behavioral Science domain knowledge 
  2. Mixed-method research experience
  3. Communication and translation of research insights

(see also image below)

6. Craig Sullivan on self experimentation

The concepts around experimentation can also be applied on yourself. Craig Sullivan explains how he (should) use it to figure out why he was having migraine attacks.

7. Amazon releases experiments and feature toggle tool

Amazon released Cloudwatch Evidently, a tool for experiments and feature management. Interesting move for anyone with their stack on AWS.

๐Ÿš€ Job opportunities

Are you looking for a new opportunity? These are this week’s featured jobs:

Or check the other 22 open roles from companies like VodafoneZiggo, IKEA, Netflix, Apple, Adidas, Gitlab, Stripe, Just Eat, Skyscanner, Lego and Spotify.

Are you hiring? Post your open roles to the job board. Readers of this newsletters can post for free, by using this coupon code at the last step: SUBSCRIBER200

๐Ÿ“… Upcoming events

This is a running list of upcoming events:

๐Ÿ’ฌ Quote of the week

“Make a list of the assumptions in a business sector, and then find the ones which aren’t true or which won’t be true in two years’ time. You’ve now got a business.” โ€” Rory Sutherland

๐Ÿ˜‰ Did you know?

Something I learned this week …

[tweet https://twitter.com/MLKessel/status/1466416660458491913]

๐Ÿ” Any feedback?

I like to hear what you think of this newsletter, Share your feedback, it takes less than a minute.

๐Ÿ™ Thanks for reading

If you’re enjoying the Experimental Mind newsletter you can buy me a coffee or beer (in case you rather use Paypal, you can send it to ‘kevin@experimentalmind.com’. Thanks to the many people who already did it. Much appreciated.

And share this email with a friend or colleague. I would love this community of experimenters to grow. You can point them here to subscribe.

Have a great week โ€” and keep experimenting.

Kevin