ECE 6605

Information Theory

Keyboard shortcuts when viewing the slides

  • ‘F’: full screen
  • ‘M’: side menu
  • ‘E’: export as PDF file (best done with Chrome)
  • ‘C’: activate canvas to write on slides
  • ‘B’: activate whiteboard associated to slide

Lectures (: slides - : pdf file with annotations)

Tuesday, August 22, 2023 Introduction and syllabus
Thursday, August 24, 2023 Probabilities
Tuesday August 29, 2023 Divergence
Thursday, August 31, 2023 Entropy and mutual information
Tuesday, September 5, 2023 More Entropy and mutual information
Thursday, September 7, 2023 Fano's inequality, Renyi entropy
Tuesday, September 12, 2023 Fano's inequality, Renyi entropy
Thursday, September 14, 2023 Typicality and source coding
Tuesday September 19, 2023 Source coding
Thursday, September 21, 2023 Source coding
Tuesday, September 26, 2023 Source coding with side information
Thursday, September 28, 2023 Source coding with side information
Tuesday, October 3, 2023 Privacy amplification
Thursday, October 12, 2023 Privacy amplification
Thursday, October 19, 2023 Channel coding
Tuesday, October 24, 2023 Channel coding
Thursday, October 26, 2023 Channel codinga and soft covering
Tuesday, October 31, 2023 Soft covering
Thursday, November 9, 2023 Soft covering
Tuesday, November 14, 2023 Soft covering
Thursday November 16, 2023 Soft covering
Tuesday, November 21, 2023 Secrecy
Tuesday, November 28, 2023 Secrecy and covertness
Thursday, November 30, 2023 Secrecy and covertness
Tuesday, December 05, 2023 Secrecy and covertness