Question: What is the unsupervised task in the final layer?
Answer: Language Modeling