Bayes for sequential decision making (I): preliminaries

Introduction In this note, we provide an introduction to the problem of sequential learning and decision making from a Bayesian perspective. With this perspective, we tackle two problems under a same framework: on the one hand, balancing exploration and exploitation, and on the other, learning a parametric model of rewards. As we will see, the first problem can be tackled with the Thompson…