The Explore vs. Exploit Dilemma

Multi-armed bandits and a prolonged analogy