To: Participants

From: Seppo J. Halme

Date: 00/09/11

Subject: S-72.340

The course on information theory will guide the student to the concept of information as used in telecommunications and also the mathematical structures and models involved. Information theory is quite demanding mathematically. Many advanced mathematical structures are used and demanding methods are used. Presently the results of information theory are extensively applied both in communications and data processing. Earlier the algorithms created in information theory were considered complicated and expensive to realize. Nowadays the powerful processors, memories and ASIC circuits can easily realize them at low cost.

The course introduces the student to the most important results of the information theory. He/she should understand how the results have been derived and what are there conditions of validity. This teaches the student mathematical methods which can be applied elsewhere.

The main results taught are the source coding theorem with optimal coding methods. The second result is the channel coding theorem with the upper bounds for error probability.

Teaching: The course is taught by prof. Seppo J. Halme (tel. 45212367, fax 4512345, email seppo.halme@hut.fi). Mr. Markku Liinaharja (tel 4515418) serves as the assistant. The studies need the completion of problem sets because mathemathical modeling and its use is learned only through personal training.

Lectures: Tuesdays 10-14, E111

Exercises: Wednesdays 12-14, H402

The students should turn up at the first lecture. Information is given on the course web page.

Literature:

1. Seppo J. Halme: Televiestintäjärjestelmät, Otakustantamo 894, 2. p. (1994), luku 8: Informaatioteorian perusteita, ss. 305...350

2. Jan Ekberg, Seppo J. Halme: Informaatioteoria, Otakustantamo 805 (1976) 100 s. Out of print.

3. Jan Ekberg, Seppo J. Halme: Koodausmenetelmät, Otakustantamo 498 (1987) 139 s.

More literature:

Robert Gallager: Information Theory and Reliable Communication, J. Wiley and Sons, Inc. (1968) SBN 471 29048 3, 588 s.

Robert M. Fano: Transmission of Information, The M.I.T. Press, Cambridge (1961) 389 s.

W. Wesley Peterson: Error-Correctiong Codes, The M.I.T. Press, Cambridge (1961), 285 s.

Robert J. McEliece: The theory of information and coding, Addison-Wesley Publ. Co., Reading (1977) ISBN 0-521-302323-4, 302 s.

Andrew J. Viterbi, Jim K. Omura: Principles of digital communication and coding, McGraw-Hill Book Co., New York (1979), ISBN 0-07-067516-3, 560 s.

Claude E. Shannon, Warren Weaver: The mathematical theory of communication, The University of Illinois Press, Urbana (1964), 125 s. (Sisältää Shannonin artikkelin Bell System Technical Journalista 1948 sekä Weaverin artikkelin Scientific Americanissa 1949)

David Slepian (ed.): Key Papers in the development of information theory, IEEE Press, New York (1973) ISBN 0-87942-028-6, 463 s.

Raymond Hill: A first course in Coding Theory, Clarendon Press, Oxford (1986) ISBN 0-19-853803-0, 251 s.
 
 

INFO340.DOC chars 2 pages