uwloo

PMATH 380AIntroduction to Information Theory

Faculty
Mathematics
Offered
Fall, Spring
Credit
0.5
Last listed
1994–95

No longer offered. It’s in Waterloo’s scanned calendars from 1976–77 to 1994–95; the 1995–96 to 2023–24 calendars are on ucalendar.

Variable length coding. The Shannon entropy as a measure of uncertainty and expected information. Minimal average length coding; the Shannon entropy as lower bound. Source entropy. Channels. Transinformation. Capacity. Applications to problem solving, Information transmission, logics, science, linguistics and communications (TV, music, etc.). Determination of practical measures of information.

As printed in the 1984–85 to 1994–95 calendars, read by OCR; the scanned page is the original. Later calendars (1995–96 on) aren’t on uwloo.

Requirements, as last listed

Prereq: Consent of instructor

Cross-listed as AM 381C

Check it elsewhere

In the scanned calendars

How it read in each calendar from 1976–77 to 1994–95, newest first. The text is OCR of the scanned pages; years whose wording matches are shown once, from the clearest scan. Each year links to its page on uwloo and to that page of the scanned PDF.

1984–85 to 1994–95 10 calendars

Variable length coding. The Shannon entropy as a measure of uncertainty and expected information. Minimal average length coding; the Shannon entropy as lower bound. Source entropy. Channels. Transinformation. Capacity. Applications to problem solving, Information transmission, logics, science, linguistics and communications (TV, music, etc.). Determination of practical measures of information.

Prereq: Consent of instructor

Cross-listed as AM 381C

Offered Fall, Spring · 3 class hours a week · 0.5 credit

* Listed that year without a description, or as not offered.

Not in the 1977–78 to 1983–84 calendars.

1976–77 1 calendar

Titled Introduction to Information Theory with Applications.

Finite probabilistic schemes. Measures of uncertainty. Shannon's Entropy as a measure of uncertainty and expected information. Maximizing expected information. Applications to problem solving in coding, logics and linguistics.

2 hours lectures, | hour tutorial. One term