hello everyone today we're looking at bird pre-training of deep bi-directional transformers for language understanding by Jacob Devlin and then why Chung Kenton Lee Cristina Tata Nova these are people from Google AI language so you're about to see the most hyped model currently so basically Bert is a model that takes as an input language sub token sequences and outputs various things so it can it can be made to do various things almost any NLP tasks with basically little training because the Bert model comes pre trained on a very