# COMPSCI 650 (Applied Information Theory)

## Instructor

Arya Mazumdar arya@cs.umass.edu

## Class

TuTh 16:00 - 17:15 Eng Lab 303

## Office Hour

By Appointment

## Syllabus

This course will introduce the basic concepts of Information Theory: entropy, relative entropy and mutual information. Applications of these concepts will be emphasized. The main topics will include information theory and statistics, inference, and learning methods.

## References

No required textbook. The following references are useful.

Thomas M. Cover, Joy A. Thomas, **Elements of Information Theory**, 2nd Edition, Wiley, Link.

David MacKay, **Information Theory, Inference, and Learning Algorithms**, Cambridge. Download free HERE.

A previous installment of this course is available HERE

## Grading Plan

TBA

## Course Communication and Materials

We will use Moodle.