Blog | Entropy as a measure of surprise

This post describes how the concept of entropy in statistics can be related to a well-defined notion of surprise, and how this can make entropy more intuitive.