ideas in there how do we actually apply this stuff in code so if you want to use a transformer I strongly recommend hopping over to the the fine folks at hugging face and using their transformer package they have both pi torch and tensor flow implementations pre-trained models ready to fine tune and I'll show you how easy it is here's how to fine tune a Bert model in just 12 lines of code you just pick what kind of Bert you want the base model that's a paying attention upper and lower case you get the tokenizer to convert your string