In this page I write some things I find interesting about information theory and machine learning in general.
On the confusion between distribution and density
From the Gibbs variational principle to the Donsker-Varadhan lemma