An introduction to Shannon’s notion of probabilistic entropy, from the viewpoint of ergodic theory and dynamical systems theory. Includes a complete proof a reasonably general (and useful!) version of the Asymptotic Equipartition Principle (AEP). Includes figures.

http://citeseer.nj.nec.com/hillman96entropy.html