Get the latest tech news
CS388: Natural Language Processing
These are the course materials for an online masters course in NLP. All lectures are videos available on YouTube.
Adapting Pretrained Representations to Diverse Tasks Matthew Peters et al., 2019 GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Wang et al., 2019 What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark et al., 2019 RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu et al., 2019 Seq2seq Models BARTBART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension Mike Lewis et al., 2019 T5Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel et al., 2020 Word Piece and Byte Pair EncodingNeural Machine Translation of Rare Words with Subword Units Rico Sennrich et al., 2016 Week 7-8: Structured Prediction: Part-of-speech, Syntactic Parsing Note: this unit was previously presented as Week 4 right after classification. Explaining the Predictions of Any Classifier Marco Tulio Ribeiro et al., 2016 Axiomatic Attribution for Deep Networks Mukund Sundararajan et al., 2017 Model ProbingBERT Rediscovers the Classical NLP Pipeline Ian Tenney et al., 2019 What Do You Learn From Context?
Or read this on Hacker News