Schedule

Make sure to reload this page to ensure you’re seeing the latest version. Readings should be done before the indicated class. Texts include:

• JM = Jurafsky and Martin, Speech and Language Processing, 3rd edition draft chapters
• Eis. = Eisenstein draft text
• Gol. = Yoav Goldberg's neural networks for NLP primer

Tue 9/4 - Introduction & Python demo // [slides]

• HW 0 released, due next Tuesday on Gradescope // LaTeX (in Overleaf)

Thu 9/6 - Text classification I (naive Bayes) // [slides]

• Reading: JM 4.1-4.6

Tue 9/11 - Text classification II: setup / logistic regression // [slides]

• Reading: JM 5.1-5.6

Thu 9/13 - Word representations (word2vec) // [slides]

• Reading: JM 6.1-6.11
• HW1 released, due Tue 9/25

Tue 9/18 - Text classification III: neural // [slides]

• (optional) Reading: Gol. 3-4 (pg. 5-19)

Thu 9/20 - Language modeling I: n-gram models // [slides]

• Reading: JM 3.1-3.5

Tue 9/25 - Language modeling II: RNNs // [slides]

• Reading: Eis. 6.3

Thu 9/27 - POS tagging with HMMs // [slides]

• Reading: JM 8.1-8.4

Tue 10/2 - Viterbi algorithm / Project discussion // [slides]

• Reading: same as last class
• HW2 (updated 10/5) released, due Fri 10/12

Thu 10/4 - Machine translation I: IBM Models + EM // [slides]

• Reading: Michael Collins' notes on IBM translation models

Tue 10/9 - No Class

Thu 10/11 - Machine translation II: Neural MT + Decoding + Eval // [slides]

• Reading: Eis. 18.1.1, 18.3, 18.4
• Project proposal template released, due Oct 19

Tue 10/16 - Intro to syntax (Mohit out, lecture by Tu Vu) // slides

• Reading: J+M 10

Thu 10/18 - Constituency parsing // [slides]

• Reading: J+M 12 (also skim over J+M 11 for CKY)

Tue 10/23 - Midterm review // [slides]

Thu 10/25 - In-class midterm

Tue 10/30 - Dependency parsing // [slides]

• Reading: J+M 13

Thu 11/1 (Mohit out for EMNLP, guest lecture by Abe Handler) // [slides]

• Optional reading: Survey on summarization

Tue 11/6 - An overview of deep learning for question answering // [slides]

• No reading!
• Progress report template released, due Fri 11/16

Thu 11/8 - Implementing neural networks for NLP in PyTorch

• Install PyTorch using the instructions in the "quick start locally" section here
• Download files for today's exercise here

Tue 11/13 - Coreference resolution // [slides]

• Reading: Eis. 15

Thu 11/15 - Semantic role labeling // [slides]

• Extra credit template released here, due 12/11
• Reading: J+M 18

Thanksgiving break - no class

• HW3 released on 11/16, due 12/7

Tue 11/27 - Dialogue systems // [slides]

• Reading: J+M 24

Thu 11/29 - Language & vision // [slides]

• Reading 1: Show, Attend, And Tell: Neural Image Caption Generation with Visual Attention
• Reading 2: VQA: Visual Question Answering
• Reading 3: A Corpus for Reasoning About Natural Language Grounded in Photographs

Tue 12/4 - Ethics in NLP // [slides]

• Reading 1: The Social Impact of Natural Language Processing
• Reading 2: Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints
• Reading 3: Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings

Thu 12/6 - Computational psycholinguistics // [slides]

• Reading: None
• posters for final projects due today!

Tue 12/11 - Final project presentations in CS 150/151