This is the lectures page for the Spring 2018 course webpage for TTIC 31190: Natural Language Processing.
Mar. 26, 2018:
Lecture 1: Introduction; Words
readings:
SLP2 Chapter 1
Mar. 28, 2018:
Lecture 2: Words, Morphology, Distributional Word Vectors
readings:
SLP3 Chapter 15;
Turney and Pantel (2010)
Apr. 2, 2018:
Lecture 3: Word Sense and Lexical Semantics
readings:
SLP3 Section 16.1 of Chapter 16,
Chapter 17
Apr. 4, 2018:
Lecture 4: Text Classification (Datasets and Modeling)
readings:
SLP3 Sections 7.0 to 7.2 of Chapter 7;
NNM4NLP Chapters 6-7
Apr. 9, 2018:
Lecture 5: Text Classification (Learning)
readings:
NNM4NLP Sections 2.7-2.8;
SLP3 Section 7.3 to the end of Chapter 7
Apr. 11, 2018:
Lecture 6: Learning for Classification; Language Modeling
readings:
NNM4NLP Sections 9.1-9.3
Apr. 16, 2018:
Lecture 7: Language Modeling, Smoothing, Neural Language Models
readings:
Collins' notes;
SLP3 Chapter 4;
Sections 8.1-8.4 of Chapter 8; Section 4 of
Goldberg's primer
Apr. 18, 2018: Short quiz at start of class;
Lecture 8: Neural Language Models and Word Embeddings
readings:
Bengio et al. (2003);
SLP3 Section 8.5 of Chapter 8,
Section 16.2 of Chapter 16;
word embedding visualization
Apr. 23, 2018:
Lecture 9: Word Embeddings
readings:
SLP3 Sections 16.2-16.3 of Chapter 16; Section 5 of
Goldberg's primer
Apr. 25, 2018:
Lecture 10: Recurrent, Recursive, and Convolutional Neural Networks for NLP
readings: Sections 9–11 of
Goldberg's primer;
Kim (2014)
demo:
lstmdemo.zip
April 30, 2018:
Lecture 11: POS Tagging and Sequence Labeling
readings:
SLP3 Sections 10.0–10.3 of Chapter 10
May 2, 2018:
Lecture 12: Sequence Labeling and Structured Prediction
readings:
SLP3 Sections 10.4–10.6 of Chapter 10;
Collins' notes on HMMs
May 7, 2018:
Lecture 13: Brown Clustering; Syntax
readings:
Phillips (2003);
Collins' notes on PCFGs;
SLP3 Chapter 12
May 9, 2018:
Lecture 14: Syntax and Parsing
readings:
SLP3 Chapter 13,
Chapter 14
May 14, 2018:
Lecture 15: Review for Midterm
May 16, 2018: Midterm
May 21, 2018:
Lecture 16: Machine Translation
readings:
Philipp Koehn's notes on NMT
May 23, 2018:
Lecture 17: Machine Translation; Semantics
May 28, 2018: No Class (Memorial Day)
May 30, 2018:
Lecture 18: Semantics
Note to those interested in reusing these course materials: Please do so! No attribution needed. PowerPoint files are also posted; just change the extension from pdf to pptx. Note that some slides were taken or adapted from Jurafsky and Martin's SLP3 slides.
Note: Lectures 12, 13, and 15 were updated on Feb. 7, 2019 to correct some errors in the description of HMMs.