A Short Tutorial on Coding

Various mis-concepts exist about coding. Some may think coding has something to do with JPEG! Other may believe coding is a form of programming. Coding refers to adding extra bits (redundant bits) to data to help correct errors occurred during transmission. This is more specifically known as error-correcting coding. Coding is the foundation of modern digital communication systems and data networks. This is so because digital data require a very low error rate. Without coding, the antenna for the transmitter would be too big or the signal-to-noise ratio required would be too high (which translates to short battery life). Coding is guaranteed to work by Shannon's famous Channel Coding Theorem. Shannon's Channel Coding Theorem tells us: as long as the data rate is smaller than a parameter associated with the channel (known as the channel capacity), it is possible to transmit data with virtually no error (with the help of a coding scheme).