|
Lecture | Date | Class topic | Reading | Homework assigned | Homework Due |
---|---|---|---|---|---|
Lecture 1 | Th Sept 7 | Introduction and course overview | Chapter 1 | Exercise Set 1: ex. 1.1-1.5 | |
Lecture 2 | Tu Sept 12 | Introduction continued and some case studies | Exercise Set 1 | ||
Lecture 3 | Th Sept 14 | Evaluative feedback | Chapter 2 | Exercise Set 2 | |
Lecture 4 | Tu Sept 19 | Evaluative feedback continued. | Exercise Set 2 | ||
Lecture 5 | Th Sept 21 | The reinforcement learning problem | Chapter 3 | Exercise Set 3 | |
Lecture 6 | Tu Sept 26 | The reinforcement learning problem continued | Exercise Set 3 | ||
Lecture 7 | Th Sept 28 | Dynamic programming | Chapter 4 | Exercise Set 4 | |
Lecture 8 | Tu Oct 3 | Dynmamic programming continued | Exercise Set 4 | ||
Lecture 9 | Th Oct 5 | Monte Carlo methods | Chapter 5 | Exercise Set 5 | |
Lecture 10 | Tu Oct 10 | Monte Carlo methods continued | Exercise Set 5 | ||
Lecture 11 | Th Oct 12 | Temporal-difference learning | Chapter 6 | Exercise Set 6 | |
Lecture 12 | Tu Oct 17 | Temporal-difference learning continued | |||
Lecture 13 | Th Oct 19 | Temporal-difference learning continued | Exercise Set 6 | ||
Lecture 14 | Tu Oct 24 | Review for midterm | |||
Lecture 15 | Th Oct 26 | In class midterm. Chapters 1-6. | |||
Lecture 16 | Tu Oct 31 | Eligibility traces | Chapter 7 | Exercise Set 7 | |
Lecture 17 | Th Nov 2 | Eligibility traces continued | |||
Lecture 18 | Tu Nov 7 | Generalization and function approximation | Chapter 8 | Exercise Set 8 | Exercise Set 7 |
Lecture 19 | Th Nov 9 | Generalization and function approximation continued | |||
Lecture 20 | Tu Nov 14 | Generalization and function approximation continued | Exercise Set 8 | ||
Lecture 21 | Th Nov 16 | Planning and learning | Chapter 9 | Exercise Set 9 | |
Lecture 22 | Tu Nov 21 | Planning and learning continued | Exercise Set 9 | ||
Thanksgiving Recess | |||||
Lecture 23 | Tu Nov 28 | Dimensions of reinforcement learning | Chapter 10 | ||
Lecture 24 | Th Nov 30 | Case studies | Chapter 11 | ||
Lecture 25 | Tu Dec 5 | Case studies continued | |||
Lecture 26 | Th Dec 7 | Student presentations | |||
Lecture 27 | Tu Dec 12 | Student presentations | |||
Lecture 28 | Th Dec 14 | Review for final exam |