Optimal Experiment Sample Sizes for Bayesian A/B Tests

This post is a spiritual successor to an early post on this blog and a fast follow here from this post about A/B test run times for Bayesians . From that post, we are able to obtain an analytic approximation to the expected impact from a single experiment using a Bayesian analysis and a given decision rule. Below is a plot like the one found in my other post, but this time perhaps with a more…