Module Code - Title:

EE6461 - INFORMATION THEORY AND CODING

Year Last Offered:

2024/5

Hours Per Week:

Lecture

2

Lab

2

Tutorial

0

Other

0

Private

6

Credits

6

Grading Type:

N

Prerequisite Modules:

Rationale and Purpose of the Module:

This module aims to guide the student through the implications and consequences of fundamental theories and laws of information theory and to impart a comprehensive grounding in source coding, random and burst error protection coding theory with reference to their increasingly wide application in present day digital communications and computer systems.

Syllabus:

Information Theory. Entropy. Information rate. ShannonÆs Theorem, channel capacity: Bandwidth - S/N trade-off. Fundamentals of information theory: source encoding theory and techniques. Communication channels: m-ary discrete memoryless, binary symmetric. Equivocation, mutual information, and channel capacity. Shannon-Hartley theorem. Channel coding: random and burst error protection on communication channels. Interleaving principles. Types and sources of error. Linear block coding. Standard Array and syndrome decoding. Cyclic and Convolution codes. Soft and hard decision detection. Viterbi decoding.

Learning Outcomes:

Cognitive (Knowledge, Understanding, Application, Analysis, Evaluation, Synthesis)

Name, depict and explain the operations preformed by a generic communications system from the data source to the data sink. Analyse the characteristics of a data source or communications channel using information theory. Design and analyse schemes for source coding. Design and analyse schemes for block and convolutional coding.

Affective (Attitudes and Values)

None

Psychomotor (Physical Skills)

None

How the Module will be Taught and what will be the Learning Experiences of the Students:

Lectures/Labs

Research Findings Incorporated in to the Syllabus (If Relevant):

Prime Texts:

Usher M.J. & Guy C.G. (1997) Information Theory and Communications for Engineers , MacMillian Press Ltd

Other Relevant Texts:

Wicker, S.B. (1995) Error Control systems for digital communications and storage , Englewood Cliffs

Lin, S. & D.J. Costello (1983) Error Coding: Fundamentals & Applications , Prentice Hall

Programme(s) in which this Module is Offered:

Semester(s) Module is Offered:

Module Leader:

Generic PRS