ECE Seminar (Short course) - Information theory and its applications in wireless communications
Supporting the below United Nations Sustainable Development Goals:支持以下聯合國可持續發展目標：支持以下联合国可持续发展目标：
This 6-hour intensive course covers some selected topics on information theory, tailored for graduate students involved in wireless communications, ideally with some basic notions of information theory.
The course begins with a review of fundamental information measures, followed by an introduction to the method of types. We then present the channel coding theorem, detailing the random coding argument and various converse techniques. Next, we demonstrate the use of variational characterisations of mutual information to derive computable upper and lower bounds of the capacity for different communication channels. Lastly, we study the maximum likelihood decoding and detection problem and show how to apply approximation methods to achieve near-optimal performance with reduced complexity.
Lecture 1: Information Measures (Entropy, Mutual Information, Divergence, Method of Types)
Lecture 2: Channel Coding Theorem (Random Coding Argument, Converse Techniques)
Lecture 3: Capacity Bounding Techniques (Variational Upper and Lower Bounds)
Lecture 4: Decoding and Detection Algorithms (Maximum Likelihood Decoding and Relaxations)
Sheng Yang received the B.E. degree in electrical engineering from Jiaotong University, Shanghai, China, in 2001, and both the engineer degree and the M.Sc. degree in electrical engineering from Telecom Paris, France, in 2004, respectively. In 2007, he obtained his Ph.D. from Université de Pierre et Marie Curie (Paris VI). From October 2007 to November 2008, he was with Motorola Research Center in Gif-sur-Yvette, France, as a senior staff research engineer. Since December 2008, he has joined CentraleSupélec, Paris-Saclay University, where he is currently a full professor. He has also hold visiting professorships in the University of Hong Kong and the Hong Kong University of Science and Technology. He received the 2015 IEEE ComSoc Young Researcher Award for the Europe, Middle East, and Africa Region (EMEA). He was an associate editor of the IEEE transactions on wireless communications from 2015 to 2020. He is currently an associate editor of the IEEE transactions on information theory
18 Aug 2025
Lecture 1: Information Measures (Entropy, Mutual Information, Divergence, Method of Types)
Lecture 2: Channel Coding Theorem (Random Coding Argument, Converse Techniques)
19 Aug 2025
Lecture 3: Capacity Bounding Techniques (Variational Upper and Lower Bounds)
Lecture 4: Decoding and Detection Algorithms (Maximum Likelihood Decoding and Relaxations)