File size: 269 Bytes
76a0881
 
 
 
1
2
3
4
# OLM-GPT2-OCT-2022

OLM-GPT2-OCT-2022 is a LLM trained with a casual langauge modeling objective on a filtered Common Crawl subset from October.
The goal of the OLM project is to train LLMs on data that focuses on recency with comparable performence to similar models.