This is the lectures page for the Spring 2018 course webpage for TTIC 31190: Natural Language Processing.


Mar. 26, 2018: Lecture 1: Introduction; Words
readings: SLP2 Chapter 1

Mar. 28, 2018: Lecture 2: Words, Morphology, Distributional Word Vectors
readings: SLP3 Chapter 15; Turney and Pantel (2010)

Apr. 2, 2018: Lecture 3: Word Sense and Lexical Semantics
readings: SLP3 Section 16.1 of Chapter 16, Chapter 17

Apr. 4, 2018: Lecture 4: Text Classification (Datasets and Modeling)
readings: SLP3 Sections 7.0 to 7.2 of Chapter 7; NNM4NLP Chapters 6-7

Apr. 9, 2018: Lecture 5: Text Classification (Learning)
readings: NNM4NLP Sections 2.7-2.8; SLP3 Section 7.3 to the end of Chapter 7

Apr. 11, 2018: Lecture 6: Learning for Classification; Language Modeling
readings: NNM4NLP Sections 9.1-9.3

Apr. 16, 2018: Lecture 7: Language Modeling, Smoothing, Neural Language Models
readings: Collins' notes; SLP3 Chapter 4; Sections 8.1-8.4 of Chapter 8; Section 4 of Goldberg's primer

Apr. 18, 2018: Short quiz at start of class; Lecture 8: Neural Language Models and Word Embeddings
readings: Bengio et al. (2003); SLP3 Section 8.5 of Chapter 8, Section 16.2 of Chapter 16; word embedding visualization

Apr. 23, 2018: Lecture 9: Word Embeddings
readings: SLP3 Sections 16.2-16.3 of Chapter 16; Section 5 of Goldberg's primer

Apr. 25, 2018: Lecture 10: Recurrent, Recursive, and Convolutional Neural Networks for NLP
readings: Sections 9–11 of Goldberg's primer; Kim (2014)
demo: lstmdemo.zip

April 30, 2018: Lecture 11: POS Tagging and Sequence Labeling
readings: SLP3 Sections 10.0–10.3 of Chapter 10

May 2, 2018: Lecture 12: Sequence Labeling and Structured Prediction
readings: SLP3 Sections 10.4–10.6 of Chapter 10; Collins' notes on HMMs

May 7, 2018: Lecture 13: Brown Clustering; Syntax
readings: Phillips (2003); Collins' notes on PCFGs; SLP3 Chapter 12

May 9, 2018: Lecture 14: Syntax and Parsing
readings: SLP3 Chapter 13, Chapter 14

May 14, 2018: Lecture 15: Review for Midterm

May 16, 2018: Midterm

May 21, 2018: Lecture 16: Machine Translation
readings: Philipp Koehn's notes on NMT

May 23, 2018: Lecture 17: Machine Translation; Semantics

May 28, 2018: No Class (Memorial Day)

May 30, 2018: Lecture 18: Semantics





Note to those interested in reusing these course materials: Please do so! No attribution needed. PowerPoint files are also posted; just change the extension from pdf to pptx. Note that some slides were taken or adapted from Jurafsky and Martin's SLP3 slides.

Note: Lectures 12, 13, and 15 were updated on Feb. 7, 2019 to correct some errors in the description of HMMs.