arXiv:2605.02989v3 Announce Type: replace Abstract: This manuscript contains preprint of a chapter in the forthcoming third edition of Cover and Thomas's Elements of Information Theory, posted with permission from Wiley. For feedback, please contact abbas@ee.stanford.edu. Learning and information theory intersect in both model training and the characterization of fundamental performance limits. This manuscript provides a concise and accessible treatment of the first intersection, requiring only basic background in information theory and statistics at the senior undergraduate / first-year graduate level. End-of-chapter exercises make the material well suited for classroom use as well as self-study. The chapter focuses on the role of divergence measures in model training, with examples ranging from linear and logistic regression to autoregressive models, variational autoencoders, diffusion models, and score-based models. In particular, the treatment of the generative diffusion model provides a more systematic and explicit derivation than is typical in the literature.