Experimental Mind: Learning, Netflix, Ethics, Principles, GA, Vaccines, Jobs…

Hey everyone,

In this week’s newsletter 6 articles, with a couple diving into the ethical side of experimentation and data collection. Important insights.

ps. for my daily writing challenge, I decided to write yesterday’s essay about my 15 Step Checklist to Write a Weekly Newsletter. Check it out if you like to have a peek behind the scenes.

πŸ”Ž What I’ve been reading last week

1. Think Learning, Not Experiments
1. Think Learning, Not Experimentsitamargilad.com

Many companies run too few experiments and learn ineffectively. Itamar Gilad explains the underlying causes and what you can do fix them.

Many companies that say they want to experiment, don’t really want to experiment. They want the mechanics, but are unwilling to adopt the underlying philosophy. They desire the benefits, without any of the (perceived) costs. They aspire to be modern and scientific, but cling on to old product development approaches.

2. Experimentation is a major focus of data science across Netflix

This is blog post 6 of a 7 part series on how Netflix uses experimentation to run their business. I highly recommend you dive in this post (and the others).

3. Ethical principles for influencing & changing behaviour

The Dutch Association of Psychologists (Nederlands Instituut van Psychologen, NIP) has defined five simplified ethical principles for anyone involved in influencing and changing behaviour:

  1. Responsibility
  2. Integrity
  3. Respect
  4. Expertise
  5. Data

From policy makers to marketers, from advertisers to process designers. Sometimes influencing behaviour has the opposite effect. There are almost always side effects. Influencing behaviour is complex, with the risk that it is harmful to people and our society. These principles reduce the chance that you act unethically, or cause (unintentionally) negative mental and behavioural effects.

4. Podcast: Ethical experimentation with Craig Sullivan
4. Podcast: Ethical experimentation with Craig Sullivanuxpodcast.com
We talk to Craig Sullivan about the explosion of mass digital experimentation, the ethical implications, and the solutions we should adopt.

5. Austrian Data Protection Authority:  usage of Google Analytics 'is in violation with GDPR'
5. Austrian Data Protection Authority: usage of Google Analytics 'is in violation with GDPR'techcrunch.com

This could have big consequences. If one country in the EU comes to this conclusion, others will follow. Of course, Google quickly came with a statement.

6. Improve your A/B tests with 9 lessons from
the COVID-19 vaccine trials

In this post, Georgi Georgiev explains what practitioners of online experimentation can learn and generalize from the COVID-19 vaccine trials.

A full year has passed since results from the first clinical trials of COVID-19 vaccines became available. Vast swaths of follow-up observational data are now in circulation which enables some conclusions about the strengths and weaknesses of those trials. 

πŸš€ Job opportunities

The job board now boosts 23 open roles.

And here are the latest featured roles:

Is your company hiring? Post your open roles to the job board. Readers of this newsletter can post for free, simply use the same email address.

πŸ“… Upcoming events

This is a running list of upcoming events:

Do you know of an event that should be on this list? Let me know.

πŸ’¬ Quote of the week

“Experimentation can’t be solved bottom up. If the leadership of an organization doesn’t care about scientific measurement, no one will.” β€” Chad Sanderson

So many people are trying to get people to care about experimentation, without the necessary support from senior leaders in the company.

πŸ˜‰ Fun of the week

Tell Me Why (source)

πŸ™ Thanks for reading

If you’re enjoying the Experimental Mind newsletter, you can buy me a coffee or beer (in case you rather use Paypal, you can send it to ‘kevin@experimentalmind.com’. Thanks to the 19 people who have already done it. Much appreciated.

Or simply share this email with a friend or colleague. Point them here to subscribe.

Have a great week β€” and keep experimenting.