spacy_demo_and_nlp_survey

A demo of spaCy's named entity recognition library as well as a survey of the history of nlp up to 2018. Both were part of a combined presentation.

From the survey...

Key Terms for understanding NLP:

• Recurrent Neural Networks
• Long Short-Term Memory Networks
• Bi-directional LSTMs
• Convolutional Neural Networks
• Recursion
• Backpropagation
• Hidden Layers
• Encoder
• Decoder
• Attention
• Self-Attention
• the transformer

Sources:

1. https://www.researchgate.net/publication/265913721_A_Comparison_of_Information_Retrieval_Models
2. Williams, Ronald J.; Hinton, Geoffrey E.; Rumelhart, David E. (October 1986). "Learning representations by back-propagating errors". Nature. 323 (6088): 533–536. Bibcode:1986Natur.323..533R. doi:10.1038/323533a0. ISSN 1476-4687. S2CID 205001834.
3. http://www.bioinf.jku.at/publications/older/2604.pdf
4. https://arxiv.org/abs/1301.3781
5. https://arxiv.org/pdf/1405.4053v2.pdf
6. https://arxiv.org/abs/1409.3215
7. https://allenai.org/allennlp/software/elmo
8. https://arxiv.org/abs/1706.03762
9. https://arxiv.org/abs/1801.06146
10. https://arxiv.org/abs/1810.04805
11. https://paperswithcode.com/method/gpt