OLM-GPT2-OCT-2022
OLM-GPT2-OCT-2022 is a LLM trained with a casual langauge modeling objective on a filtered Common Crawl subset from October.
The goal of the OLM project is to train LLMs on data that focuses on recency with comparable performence to similar models.
