Detailed Calendar
Required and additional readings, to be updated (bi)weekly. Additional readings are not mandatory.
| Week |
Date |
Class Topics |
Readings |
Work Due |
| 1 |
Jan 8 |
Introduction and Course Overview
|
|
|
| Jan 10 |
Class Cancelled
|
|
|
| 2 |
Jan 15 |
No Class / MLK Day
|
|
|
| Jan 17 |
n-gram Language Models I
|
Jurafsky and Martin, 3.1-3.3
|
HW1 Released |
| 3 |
Jan 22 |
n-gram Language Models II
|
Jurafsky and Martin, [Chap 3.4-3.7]
Additional: Mitchell, Chap 2, Estimating Probabilities
|
|
| Jan 24 |
Project Pitches
|
|
|
| 4 |
Jan 29 |
Logistic Regression
|
Jurafsky and Martin, [Chap 5.1-5.2,5.4-5.5]
|
|
| Jan 31 |
Logistic Regression II
|
Jurafsky and Martin, [Chap 5.3, 5.6-5.8]
|
HW1 Due |
| 5 |
Feb 5 |
Word Embeddings I
|
Jurafsky and Martin, [Chap 6.3-6.7]
|
|
| Feb 7 |
Word Embeddings II
|
Jurafsky and Martin, [Chap 6.8-6.13]
|
Project Proposal Due; HW2 Released |
| 6 |
Feb 12 |
Feedforward Neural Net Language Models
|
Jurafsky and Martin, [Chap 7]
|
|
| Feb 14 |
Recurrent Neural Net Language Models
|
Jurafsky and Martin, [Chap 9]
|
|
| 7 |
Feb 19 |
No Class / President's Day
|
|
|
| Feb 21 |
Sequence-to-Sequence and Attention
|
Jurafsky and Martin, [Chap 9.7-9.8]
|
|
| 8 |
Feb 26 |
Transformers - Building Blocks
|
Jurafsky and Martin, [Chap 10]
|
HW2 Due |
| Feb 28 |
Project Discussions
|
|
|
| 9 |
Mar 4 |
Transformers - Building Blocks II
|
Jurafsky and Martin, [Chap 10]
|
Project Progress Report; HW3 Released |
| Mar 6 |
PyTorch Demo
|
|
|
| 10 |
Mar 11 |
Spring Break
|
|
|
| Mar 13 |
Spring Break
|
|
|
| 11 |
Mar 18 |
Pretraining and Finetuning Transformers
|
Jurafsky and Martin, [Chap 11.1-11.2]
|
|
| Mar 20 |
Pretraining and Finetuning Transformers - Contd.
|
Jurafsky and Martin, [Chap 11.3]
|
HW3; HW4 Released |
| 12 |
Mar 25 |
LLM Harms - Guest Lecture
|
|
|
| Mar 27 |
Language Generation
|
Jurafsky and Martin, [Chap 13.4]
|
|
| 13 |
Apr 1 |
Language Generation - Modern Sampling
|
Jurafsky and Martin, [Chap 10.8]
|
|
| Apr 3 |
Evaluating Generations + Prompting and Instruction Tuning
|
Jurafsky and Martin, [Chap 13.6]
|
HW4 Due |
| 14 |
Apr 8 |
Project Discussions
|
|
|
| Apr 10 |
Aligning LLMs
|
|
|
| 15 |
Apr 15 |
Advanced Topics + Putting it all together
|
|
|
| Apr 17 |
Final Presentations I
|
|
|
| 16 |
Apr 22 |
Final Presentations II
|
|
|
| Apr 24 |
Final Presentations III
|
|
|