This week three new reads/tools. Plus the latest jobs and events.
Convert—A/B tests & personalization for growth teams
Experimentation Jobs—Find your next role
Interactive A/B testing course
Mark Eltsefon created this course: eight chapters covering everything from p-values to switchback designs, with 29+ simulators you actually run yourself. First chapter is free. Built for analysts, PMs, and engineers who want to understand experimentation. TRY
____
[Paper] Trustworthy A/B patterns
Ronny Kohavi et al. performed eight large-scale replications of popular CRO patterns like rounded buttons, page speed, coupon fields and sticky CTAs. Results show that previously reported effects are wildly exaggerated. Only two replications showed significant effects in the expected direction. READ
____
Hugging the x-axis
Essay by David Perell where he states that optionality feels like freedom but keeps you flat. The biggest rewards of going all, deep relationships, compounding expertise, meaningful work, go to people who commit. Western culture seems to over indexe on novelty. Raise your commitment level. Leave the x-axis. READ
____
Last week’s favourite: Hello Power
Jakub Linowski created this interactive simulator letting you lock and unlock A/B test parameters. Play with the base rate, MDE, sample size, power and alpha. You will see the trade-offs in real time. Much more powerful than just reading about them. PLAY
Find 1k+ open roles on ExperimentationJobs.com. This week’s featured roles:
CRO Manager at Sunny Cars (Haarlem, Netherlands)
Lead UX Consultant / Team Lead at Creative CX (London, United Kingdom)
Director of Conversion Rate Optimization (CRO) at Ground News (USA or Canada)
Sr. Growth Marketing Manager, Website & Conversion Optimization at RentSpree (Seattle, United States)
Marketing Technology & Automation – Lead Experimentation Engineer at Whitbread (London, United Kingdom)
A running list of upcoming events. Subscribe here. (👋= join me, 🎁= discount)
👋16 Jul: Experimentation Culture Awards (online)
29 Jul: Experimentation London #12 (London, UK)
31 Jul: TLC: 5 Stories to Rewire Your Statistical Intuition with Ishan Goel (online)
9-10 Sep: Women in Experimentation Summit (online)
👋24 Sep: Experimentation Elite Awards (London, UK)
👋5 Nov: Experimentation Heroes (Amsterdam, Netherlands)
Someone suggested that Optimizely’s new icon looks like an avocado …
If this newsletter sparked something and you want to talk it through, a few ways I help:
Scale experimentation
Strategy, setup, metrics, and ways of working for teams that want more impact.Careers and hiring
Support with your next role, or help finding and hiring strong experimenters.Quick sparring
A fresh outside perspective on your ideas, roadmap, or experimentation setup.
Interested?
Just hit reply and tell me what you’re thinking about.
Have a great week and keep experimenting.
Thanks, Kevin
Comments
Nothing yet. Say the first thing.
Sign in to join the conversation.