Information-theoretic Limits of Learning and Estimation

ArXi:2605.06710v1 Announce Type: cross Information theory plays a central role in establishing fundamental limits on what any learning or estimation algorithm can -- and cannot -- achieve, regardless of computational power. In this chapter, we provide an This manuscript contains preprint of a chapter under consideration for inclusion in the forthcoming third edition of Cover and Thomas's Elements of Information Theory, posted with permission from Wiley. It would follow the chapter posted at arXi:2605.02989. The of the new edition can be found at.