Vincent D. Warmerdam - Why Transformers Work
Channel: EuroPython Conference
Date: 28/09/2020

"Why Transformers Work
EuroPython 2020 - Talk - 2020-07-24 - Microsoft
Online

By Vincent D. Warmerdam

This will be a technical talk where I'll explain the inner workings of the machine learning algorithms inside of Rasa. In particular I'll talk about why the transformer has become a part in many of our algorithms and has replaced RNNs. These include use-cases in natural language processing but also in dialogue handling. 

You'll see a live demo of a typical error that an LSTM would make but a transformer wouldn't. The algorithms are explained with calm diagrams and very little maths.



License: This video is licensed under the CC BY-NC-SA 3.0 license: https://creativecommons.org/licenses/by-nc-sa/3.0/
Please see our speaker release agreement for details: https://ep2020.europython.eu/events/speaker-release-agreement/

    "