CMPSCI 687

Reinforcement Learning

Fall 2000


Course Schedule

(subject to minor revision; click on lecture number to see view graphs)

Lecture Date Class topic Reading Homework assigned Homework Due
Lecture 1 Th Sept 7 Introduction and course overview Chapter 1 Exercise Set 1: ex. 1.1-1.5
Lecture 2 Tu Sept 12 Introduction continued and some case studies Exercise Set 1
Lecture 3 Th Sept 14 Evaluative feedback Chapter 2 Exercise Set 2
Lecture 4 Tu Sept 19 Evaluative feedback continued. Exercise Set 2
Lecture 5 Th Sept 21 The reinforcement learning problem Chapter 3 Exercise Set 3
Lecture 6 Tu Sept 26 The reinforcement learning problem continued Exercise Set 3
Lecture 7 Th Sept 28 Dynamic programming Chapter 4 Exercise Set 4
Lecture 8 Tu Oct 3 Dynmamic programming continued Exercise Set 4
Lecture 9 Th Oct 5 Monte Carlo methods Chapter 5 Exercise Set 5
Lecture 10 Tu Oct 10 Monte Carlo methods continued Exercise Set 5
Lecture 11 Th Oct 12 Temporal-difference learning Chapter 6 Exercise Set 6
Lecture 12 Tu Oct 17 Temporal-difference learning continued
Lecture 13 Th Oct 19 Temporal-difference learning continued Exercise Set 6
Lecture 14 Tu Oct 24 Review for midterm
Lecture 15 Th Oct 26 In class midterm. Chapters 1-6.
Lecture 16 Tu Oct 31 Eligibility traces Chapter 7 Exercise Set 7
Lecture 17 Th Nov 2 Eligibility traces continued
Lecture 18 Tu Nov 7 Generalization and function approximation Chapter 8 Exercise Set 8 Exercise Set 7
Lecture 19 Th Nov 9 Generalization and function approximation continued
Lecture 20 Tu Nov 14 Generalization and function approximation continued Exercise Set 8
Lecture 21 Th Nov 16 Planning and learning Chapter 9 Exercise Set 9
Lecture 22 Tu Nov 21 Planning and learning continued Exercise Set 9
Thanksgiving Recess
Lecture 23 Tu Nov 28 Dimensions of reinforcement learning Chapter 10
Lecture 24 Th Nov 30 Case studies Chapter 11
Lecture 25 Tu Dec 5 Case studies continued
Lecture 26 Th Dec 7 Student presentations
Lecture 27 Tu Dec 12 Student presentations
Lecture 28 Th Dec 14 Review for final exam