This is the lectures page for the Spring 2017 course webpage for TTIC 31210: Advanced Natural Language Processing.
Mar. 27, 2017:
Lecture 1: Introduction
readings: review course material of
TTIC 31190
Mar. 29, 2017: Instructor away. TA will hold an office hour during class. Ask questions about material from TTIC 31190, python, or deep learning toolkits.
Apr. 3, 2017:
Lecture 2: Elements of Neural NLP
readings:
Yoav Goldberg's primer;
Kyunghyun Cho's notes
Apr. 5, 2017: No class (instructor away)
Apr. 10, 2017:
Lecture 3: Word Embeddings
readings:
Bengio et al. (2003),
Collobert et al. (2011)
Apr. 12, 2017:
Lecture 4: Word Embeddings (2)
readings:
Mikolov et al. (2013a),
Mikolov et al. (2013b)
Apr. 17, 2017:
Lecture 5: Sequence-to-Sequence Modeling and Sentence Embeddings
readings:
Graves (2013),
Sutskever et al. (2014)
Apr. 19, 2017:
Lecture 6: Structured Prediction with Neural Networks in Speech Recognition (guest lecture by
Liang Lu)
Apr. 24, 2017:
Lecture 7: Sequence-to-Sequence Modeling and Attention
Apr. 26, 2017:
Lecture 8: Neural Machine Translation
May 1, 2017:
Lecture 9: NMT, finishing up Neural NLP
May 3, 2017:
Lecture 10: Introduction to Bayesian NLP
readings: Chapters 1 and 2 of
Cohen (2016)
May 8, 2017:
Lecture 11: Inference in Bayesian NLP
readings: Chapter 5 of
Cohen (2016), up to 5.3.1
May 10, 2017: No class (instructor out sick)
May 15, 2017:
Lecture 12: Bayesian Inference, Unsupervised NLP
readings: Chapter 3 and Section 5.3.1 of
Cohen (2016),
Ng's EM notes
May 17, 2017:
Lecture 13: Introduction to Bayesian Nonparametrics in NLP
readings: Chapter 7 of
Cohen (2016)
May 22, 2017:
Lecture 14: Finish Bayesian and Unsupervised NLP, start Structured Prediction
May 24, 2017:
Lecture 15: Structured Prediction in NLP
May 29, 2017: No class (Memorial Day)
May 31, 2017:
Lecture 16: Structured Prediction, Syntactic and Semantic Formalisms
Note to those interested in reusing these course materials: Please do so! No attribution needed. PowerPoint files are also posted; just change the extension from pdf to pptx.