Link Search Menu Expand Document

Detailed Calendar

Required and additional readings, to be updated (bi)weekly. Additional readings are not mandatory.

Week Date Class Topics Readings Work Due
1 Jan 8 Introduction and Course Overview
Jan 10 Class Cancelled
2 Jan 15 No Class / MLK Day
Jan 17 n-gram Language Models I Jurafsky and Martin, 3.1-3.3 HW1 Released
3 Jan 22 n-gram Language Models II Jurafsky and Martin, [Chap 3.4-3.7] Additional: Mitchell, Chap 2, Estimating Probabilities
Jan 24 Project Pitches
4 Jan 29 Logistic Regression Jurafsky and Martin, [Chap 5.1-5.2,5.4-5.5]
Jan 31 Logistic Regression II Jurafsky and Martin, [Chap 5.3, 5.6-5.8] HW1 Due
5 Feb 5 Word Embeddings I Jurafsky and Martin, [Chap 6.3-6.7]
Feb 7 Word Embeddings II Jurafsky and Martin, [Chap 6.8-6.13] Project Proposal Due; HW2 Released
6 Feb 12 Feedforward Neural Net Language Models Jurafsky and Martin, [Chap 7]
Feb 14 Recurrent Neural Net Language Models Jurafsky and Martin, [Chap 9]
7 Feb 19 No Class / President's Day
Feb 21 Sequence-to-Sequence and Attention Jurafsky and Martin, [Chap 9.7-9.8]
8 Feb 26 Transformers - Building Blocks Jurafsky and Martin, [Chap 10] HW2 Due
Feb 28 Project Discussions
9 Mar 4 Transformers - Building Blocks II Jurafsky and Martin, [Chap 10] Project Progress Report; HW3 Released
Mar 6 PyTorch Demo
10 Mar 11 Spring Break
Mar 13 Spring Break
11 Mar 18 Pretraining and Finetuning Transformers Jurafsky and Martin, [Chap 11.1-11.2]
Mar 20 Pretraining and Finetuning Transformers - Contd. Jurafsky and Martin, [Chap 11.3] HW3; HW4 Released
12 Mar 25 LLM Harms - Guest Lecture
Mar 27 Language Generation Jurafsky and Martin, [Chap 13.4]
13 Apr 1 Language Generation - Modern Sampling Jurafsky and Martin, [Chap 10.8]
Apr 3 Evaluating Generations + Prompting and Instruction Tuning Jurafsky and Martin, [Chap 13.6] HW4 Due
14 Apr 8 Project Discussions
Apr 10 Aligning LLMs
15 Apr 15 Advanced Topics + Putting it all together
Apr 17 Final Presentations I
16 Apr 22 Final Presentations II
Apr 24 Final Presentations III