Information Theory
For honours courses please contact the School Office.
Description
Five broad topics are addressed:
(1) the concepts of information and uncertainty;
(2) noiseless coding;
(3) stationary information sources;
(4) memoryless channels;
(5) group codes.
Objective
To introduce the basics of information theory in the discrete Shannon formulation. The course aims to make the student familiar with the underlying concepts, including working through elementary problems.
Content
Uncertainty, Shannon's uniqueness theorem,
properties of uncertainty, information, noiseless coding, unique
decipherability, instantaneous codes, Huffman constructions. Kraft's
theorem, McMillan's theorem, Shannon's first coding theorem, ideal
observer and maximum likelihood decision schemes, fundamental theorem
of coding, stationary sources, uncertainty of a source, Markov
sources, unifilar sources, uncertainty of a state. The asymptotic
equipartition property. Error correcting codes, parity check for
group codes, decoding parity check codes, cyclic codes, feedback shift
registers, Bose-Chaudhuri-Hocquenhem codes.
|
|
| Year |
Semester |
Level |
Units |
| 2012 |
1 |
Honours |
3 |
Delivery
24 hours lectures
Assessment
written assignments 20%, final exam 80%
Graduate attributes
Linkage past
No past linkages have been noted.
Linkage present
No present linkages have been noted.
Linkage future
This course is not recorded as prequisite for other courses.
Restrictions
None.
Recommended text
References: a substantial list will be provided in lectures
|
