Abstract

In the past two decades, researchers in information theory have obtained very fruitful results in the study of the Shannon entropy. This study has led to the discovery of a new class of constraints on the Shannon entropy, called non-Shannon-type inequalities. Intimate connections between the Shannon entropy and different branches of mathematics including finite group theory, combinatorics, Kolmogorov complexity, probability, matrix theory, etc, have been established. All these discoveries are based on a geometrical interpretation of constraints on the entropy function. We assert that the same formality can be applied to the study of inequalities in other branches of mathematics. To illustrate the idea, we revisit with this formality a few celebrated inequalities: the AM-GM inequality, the Markov inequality, and the Cauchy-Scharwz inequality. Applications of this formality has the potential of leading to the discovery of new inequalities in different branches of mathematics.

Bio: Raymond W. Yeung is a Choh-Ming Li Professor of Information Engineering at The Chinese University of Hong Kong (CUHK). He received his B.S., M.Eng., and Ph.D. degrees from Cornell University in Electrical Engineering in 1984, 1985, and 1988, respectively. Before joining CUHK in 1991, he was a Member of Technical Staff at AT&T Bell Laboratories. He has been serving as Co-Director of the Institute of Network Coding at CUHK since 2010. He is the author of the books A First Course in Information Theory (Kluwer Academic/Plenum Publishers, 2002) and Information Theory and Network Coding (Springer 2008), which have been adopted by over 100 institutions around the world. In spring 2014, he gave the first MOOC in the world on information theory that reached over 60,000 students to date.

He is a recipient of the 2005 IEEE Information Theory Society Paper Award, the Friedrich Wilhelm Bessel Research Award from the Alexander von Humboldt Foundation in 2007, the 2016 IEEE Eric E. Sumner Award, the 2018 ACM SIGMOBILE Test-of-Time Paper Award, the 2021 IEEE Richard W. Hamming Medal, and the 2022 Claude E. Shannon Award. In 2015, he was named an Outstanding Overseas Chinese Information Theorist by the China Information Theory Society. He is a Fellow of the IEEE , Hong Kong Academy of Engineering Sciences, Hong Kong Institution of Engineers, and the US National Academy of Inventors.