NLP with Neural Networks & Transformers
Channel: CodeEmporium
Date: 24/02/2020

Talking about How Natural Language Processing has progressed with Neural Networks. How have Transformers influenced the game with ELMo, BERT, OpenAI Transformers, XLNet and more!

Like and subscribe for more amazing content!

REFERENCES

[1] Analytics Vidhya Blog on NLP Models: https://www.analyticsvidhya.com/blog/2019/06/understanding-transformers-nlp-state-of-the-art-models/
[2] NLP’s imageNet moment has arrived – Amazing blog: https://ruder.io/nlp-imagenet/
[3] Techcrunch Blog on hugging face: https://techcrunch.com/2019/12/17/hugging-face-raises-15-million-to-build-the-definitive-natural-language-processing-library/
[4] Original Word2Vec paper in 2013: https://arxiv.org/pdf/1301.3781.pdf
[5] Intro to Word2Vec: https://towardsdatascience.com/introduction-to-word-embedding-and-word2vec-652d0c2060fa
[6] The paper that introduced Transformer Neural Networks: https://arxiv.org/abs/1706.03762
[7] Elmo Original Paper in 2018: https://arxiv.org/abs/1802.05365
[8] Wonderful illustration of BERT: http://jalammar.github.io/illustrated-bert/
[9] Another Blog with BERT explained: https://www.analyticsvidhya.com/blog/2019/09/demystifying-bert-groundbreaking-nlp-framework/
[10] OpenAI on their new langauge models: https://openai.com/blog/better-language-models/
[11] Neural Machine Translation with LSTM + Attention: https://arxiv.org/abs/1409.0473
[12] XLNet original paper: https://arxiv.org/abs/1906.08237
[13] XLNet paper dissected: https://mlexplained.com/2019/06/30/paper-dissected-xlnet-generalized-autoregressive-pretraining-for-language-understanding-explained/
[14] Huggingface: https://huggingface.co/transformers/
[15] Spacy ml: https://spacy.io/api
[16] Neural Machine Translation – How it used to be done with LSTM Networks: https://arxiv.org/abs/1409.0473