Homework assignments

See Gradescope for the most up to date due date.

• HW1, due Wed 9/25.
• HW2, with multiple due dates; see PDF.

Schedule

Lecture topics will appear below. Make sure to reload this page to ensure you’re seeing the latest version. Readings should be done before the indicated class. The main textbook is available free online:

• JM = Jurafsky and Martin, Speech and Language Processing, 3rd edition. (Main textbook.)
• INLP = Eisenstein, Intro to NLP, online text (or book version; we'll have readings from this one occasionally, and it's recommended in general.)

Tue 9/3: Introduction

Thu 9/5: Words and regular expressions

• Reading: JM ch. 2.1-2.4
• Optional: Ken Church, "Unix for Poets"
• Optional: RegexOne
• Optional: David C. Zentgraf, "What Every Programmer Absolutely, Positively Needs To Know About Encodings And Charater Sets To Work With Text"
• Tokenization demo
• "Exercise" 1: Class survey (electronic only on Gradescope)

Tue 9/10 and Thu 9/12: Text Classification and Naive Bayes (annotated)

• Reading: JM 4.1-4.6
• Optional: INLP 4.1-4.3
• In-class activity: Manual keywords.

Tue 9/17: Logistic Regression Classification (annotated)

• Reading: JM ch. 5.1-5.5
• Exercise 2: Logistic regression, on slide 12. (Gradescope makeup: make PDF for the answer for slide 12.)

Tue 9/24: Classification Evaluation (annotated)

• Reading: JM 5.7
• Reading: JM 4.7, 4.8, 4.10

Tue 9/24 + Thu 9/26: Annotations (annotated)

• Reading: INLP, 4.5
• Exercise 3: Interannotator agreement

Tue 10/1: Text Data and Final Project Overview

Thu 10/3: Syntax (I): Tagging and CFGs

• Reading: JM 17.1-17.3 (Word Classes, POS Tagging, NER)
• Reading: JM 18.1-18.5 (Context-Free Grammars); will revisit next week
• Exercise 4: Parts of speech

Tue 10/8: Syntax (II): Grammar exercise session (slides)

• Exercise 5: CFG
• Extra reading: INLP Ch. 9, which has the exercise grammar.

Thu 10/10: Syntax (III): Dependency Parsing (annotated)

• Reading: JM 19.1-19.2 (Dependency Relations, Transition-Based Dependency Parsing)
• HW2 "Phase 2" is due on Friday.

Tue 10/15: No class (Monday class schedule)

Thu 10/17: N-Gram Language Models

• Reading: JM 3.1-3.7 (N-grams, Evaluation, Sampling, Generalization, Interpolation, Entropy)

Topics in late October and November: word embeddings, Transformer networks, BERT, generative large language models, etc.

Tue 11/5: No class (Election Day)

Thu 11/28: No class (Thanksgiving)

Tue 12/3 and Thu 12/5: Project Presentations

Tu 12/10: TBD

12/18: Final projects due (end of final exam period)

• Full project details in the Final Project webpage