Experimental Mind: Bets, Roadmapping, Philosophy, Randomization, Zoom, Salary…

Hi everyone, and a special welcome to the 5 new subscribers.

As always I’ve handpicked the best experimentation content, events and job opportunities from around the world. Let’s dive in.

ps. we are looking for an Analyst to strenghten Vista’s experimentation team

🔎 What I’ve been reading this week

1. Bets, success metrics, and roadmapping

In my new role I am creating a roadmap for our internal experimentation platform. I always come back to the work John Cutler does on this topic. In this Google doc he outlines his thinking around bets, succes metrics and create a roadmap. Useful content.

2. Podcast: 'Experimentation as a business philosophy'

In this episode, Luka Nikolić shares why it’s better to adopt a mindset of experimentation to make the right decisions and deliver value to customers.

3. Parameter exploration at Lyft
At Lyft, the experimentation team’s purpose is to drive data-driven decision making. We primarily do so by facilitating different experiment techniques including AB testing, time-split experiments…

4. Randomization, blocking, and re-randomization

The three fundamental statistical concepts of A/B testing: randomization, blocking, and re-randomization.

5. Should I ask over Zoom, phone, or in-person?

Interesting research paper trying to answer which communication channel you should use in case you need to ask for help.

In two experiments, we found that seeking help in-person was far superior to seeking help through any form of mediated communication channel—including seeking help over synchronous, with-face video channels. Nonetheless, we found that richer media channels do still offer an advantage over text-based channels. Yet, importantly, help-seekers appear largely unaware of both these facts.

6. Experiment Nation's 2021 average CRO salary survey
A question we’ve heard asked quite often in the Experiment Nation community is what should a CRO expect to be paid? After 2 minutes of Googling, we couldn’t find any great information so we decided to collect it ourselves! All information is confidential and only averages will be shared.

🚀 Job opportunities

Are you looking for a new opportunity? These are this week’s featured jobs:

Or check the other 17 open roles from companies like Netflix, Apple, Adidas, Gitlab, Stripe, Just Eat, Skyscanner, Lego and Spotify.

Are you hiring? Post your open roles to the job board. Readers of this newsletters can post for free, by using this coupon code at the last step: SUBSCRIBER200

📅 Upcoming events

This is a running list of upcoming events. First 2022 event is on it:

💬 Quote of the week

“”When you invent the ship, you also invent the shipwreck; when you invent the plane you also invent the plane crash; and when you invent electricity, you invent electrocution… Every technology carries its own negativity, which is invented at the same time as technical progress.” — Paul Virilio

😉 Fun of the week

This tweet was (again) making the rounds this week. I tried it as well and now each morning I wake up with a smile on my face. Let’s see how long the effect stays.

[tweet https://twitter.com/Ivyzenati/status/999642815838740485]

🔁 Any feedback?

I like to hear what you think of this newsletter, Share your feedback, it takes less than a minute.

🙏 Thanks for reading

If you’re enjoying the Experimental Mind newsletter you can buy me a coffee or beer. Thanks to the 12 people who already did it. Much appreciated.

And share this email with a friend or colleague. I would love this community of experimenters to grow. You can point them here to subscribe.

Have a great week — and keep experimenting.

Kevin

Related Posts