Definition of information, memory less information sources, the Markov information source; Entropy: Extended sources; Shannon’s noiseless coding theorem; Source coding; Mutual information; Channel capacity: BSC and other channels; Shannon’s channel capacity theorem; continuous channels; comparison of communication systems based on information theory; Channel coding block and convolution block codes-Hamming, cyclic and BCH. Performance of block code; Convolution codes and majority logic decoding; Viterbi decoding algorithm; Coding gains and performance.
