"Information entropy" . "probabilities" . "Shannon entropies" . "Shannon's entropy" . "Shannon-entropy" . "entropy in information theory" . . "information theory" . "Entropy in information theory" . "empirical entropy" . "Entropy (information theory)" . . "individual entropy" . . "entropy is proportional to information" . "classical entropy" . . "Entropy" . . "information perspective of entropy" . "Shannon's information entropy" . "entropies" . . "Information" . . "classical differential entropy" . . "Information theoretic (Shannon) entropy" . "Entropy (information theory)" . "Shannon entropy" . . . "Shannon's entropy measure" . . . "classical information" . . "entropy" . "word entropy" . "bit entropy" . . . "information entropy" . . "entropy (information theory)" . . . "characterization of entropy" . . . "(Shannon) entropy" . . "the logarithm of the probability" . "classical" . "entropy of information" . . "informative" . . . . "information-theoretic entropy" . . "Claude Shannon's entropy formula" . . "the statistical notion of information" . "information" . . . "Boltzmann-Shannon information" . . "k-th order empirical entropy" . "discrete entropy" .