Lecture recordings will be available on Panopto. Click on the topic below to download the slides from that lecture.
| Date | Topic | Miscellaneous | References |
|---|---|---|---|
| 8/30/2022 (Tue) | Introduction | ||
| 9/1/2022 (Thu) | Text Classification 1 (naive bayes, logistic regression) | Eisenstein: 2.1, 2.2, 2.5, 2.6 | |
| 9/6/2022 (Tue) | Text Classification 2 (non-linear classification) | Assignment 0 (warmup) out | Eisenstein: 3.1-3.3 |
| 9/8/2022 (Thu) | Language Modeling 1 (n-grams) | Eisenstein: 6.1 Jurafsky & Martin: 3.1 |
|
| 9/13/2022 (Tue) | Language Modeling 2 (info-theory + evaluation) | Eisenstein: 6.2, 6.4 Jurafsky & Martin: 3.2, 3.4, 3.5, 3.7 |
|
| 9/15/2022 (Thu) | Language Modeling 3 (neural LMs) | Assignment 0 due Assignment 1 out | Jurafsky & Martin: Chapter 7 Graham Neubig's notes Mike Collins' notes |
| 9/20/2022 (Tue) | Language Modeling 4 (RNNs + Transformers) | Eisenstein: 6.3 Jurafsky & Martin: 9.1-9.4 |
|
| 9/22/2022 (Thu) | Structured Prediction 1 (generative sequence models) | Eisenstein: 7.1-7.4; 8.1-8.3 | |
| 9/27/2022 (Tue) | Structured Prediction 2 (discriminative sequence models) | Eisenstein: 7.5-7.6 (excluding 7.5.1-7.5.2); Sutton & McCallum CRF tutorial | |
| 9/29/2022 (Thu) | Structured Prediction 3 (trees + PCFGs) | Assignment 1 due Assignment 2 out | Eisenstein: 9.2, 10.1-10.5 |
| 10/4/2022 (Tue) | Structured Prediction 4 (seq2seq) | Eisenstein: 18.3-18.5 | |
| 10/6/2022 (Thu) | Project Guidelines + Review | Crafting Papers on Machine Learning Stanford CS224N Project Tips |
|
| 10/11/2022 (Tue) | Fall Break (no class) | ||
| 10/13/2022 (Thu) | Formal Semantics | Assignment 2 due | Eisenstein: 12 |
| 10/18/2022 (Tue) | Distributional Semantics | Eisenstein: 14.1-14.3, 14.5, 14.6 | |
| 10/20/2022 (Thu) | Pretraining 1 (ELMo, GPT) | Project Proposals due | Peters et al; 2018 Radford et al; 2018 Devlin et al; 2018 |
| 10/24/2022 (Mon) | Assignment 3 out | ||
| 10/25/2022 (Tue) | Pretraining 2 (BERT, T5) | Raffel et al; 2019 Clark et al; 2020 Lan et al; 2020 |
|
| 10/27/2022 (Thu) | Prompting | Liu et al; 2021 How does in-context learning work? |
|
| 11/1/2022 (Tue) | Question Answering 1 (retrieval) | Jurafsky & Martin: Chapter 23.1 Karpukhin et al; 2020 |
|
| 11/3/2022 (Thu) | Question Answering 2 (reading comprehension) | Jurafsky & Martin: Chapter 23.2 Roberts et al; 2020 |
|
| 11/7/2022 (Mon) | Assignment 3 due | ||
| 11/8/2022 (Tue) | Question Answering 3 (cont) | ||
| 11/10/2022 (Thu) | Information Extraction | Eisenstein 17.1, 17.2 | |
| 11/15/2022 (Tue) | Text Generation | Quiz | Eisenstein 18, 19. |
| 11/17/2022 (Thu) | Efficient Transformers | Tay et al; 2020 | |
| 11/22/2022 (Tue) | Interpretability + Ethics | ||
| 11/24/2022 (Thu) | Thanksgiving Break (no class) | ||
| 11/29/2022 (Tue) | Project Presentations 1 | ||
| 12/1/2022 (Thu) | Project Presentations 2 | ||
| 12/16/2022 (Fri) | Project reports due |
