Abstract
This chapter is devoted to classical information theory fundamentals and its application to fading channels and channels with memory. The chapter starts with definitions of entropy, joint entropy, conditional entropy, relative entropy, mutual information, and channel capacity, followed by the information capacity theorem. We discuss the channel capacity of discrete memoryless channels, continuous channels, and channels with memory. Regarding the wireless channels, we describe how to calculate the channel capacity of flat-fading and frequency-selective channels. We also discuss different optimum and suboptimum strategies to achieve channel capacity, including the water-filling method, multiplexed coding and decoding, channel inversion, and truncated channel inversion. We also study different strategies for channel capacity calculation depending on what is known about the channel state information. Further, we explain how to model the channel with memory and describe McMillan-Khinchin model for channel capacity evaluation. Then, the fundamentals of linear block codes are introduced, followed by the binary LDPC coding fundamentals.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Djordjevic, I. B. (2013). Advanced coding for optical communication systems. In I. Kaminow, T. Li, & A. Willner (Eds.), Optical fiber telecommunications VI (pp. 221–296). Elsevier/Academic Press.
Djordjevic, I. B., Ryan, W., & Vasic, B. (2010). Coding for optical channels. Springer.
Cvijetic, M., & Djordjevic, I. B. (2013). Advanced optical communication systems and networks. Artech House.
Djordjevic, I. B. (2016). On advanced FEC and coded modulation for ultra-high-speed optical transmission. IEEE Communications Surveys and Tutorials, 18(3), 1920–1951, third quarter 2016. https://doi.org/10.1109/COMST.2016.2536726
Cover, T. M., & Thomas, J. A. (1991). Elements of information theory. John Wiley & Sons.
Reza, F. M. (1961). An introduction to information theory. McGraw-Hill.
Gallager, R. G. (1968). Information theory and reliable communication. John Wiley & Sons.
Ingels, F. M. (1971). Information and coding theory. Intext Educational Publishers.
Haykin, S. (2004). Communication systems. John Wiley & Sons.
Wolfowitz, J. (1964). Coding theorems of information theory (2nd ed.). Springer-Verlag.
Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 379–423, 623–656.
Goldsmith, A. (2005). Wireless communications. Cambridge University Press.
Tse, D., & Viswanath, P. (2005). Fundamentals of wireless communication. Cambridge University Press.
Benedetto, S., & Biglieri, E. (1999). Principles of digital transmission with wireless applications. Kluwer Academic/Plenum Publishers.
Biglieri, E. (2005). Coding for wireless channels. Springer.
Duman, T. M., & Ghrayeb, A. (2007). Coding for MIMO communication systems. John Wiley & Sons.
Proakis, J. G. (2001). Digital communications. McGraw-Hill.
McMillan, B. (1952). The basic theorems of information theory. Annals of Mathematical Statistics, 24, 196–219.
Khinchin, A. I. (1957). Mathematical foundations of information theory. Dover Publications.