omarmomen
/

structformer_s1_final_with_pos

Model card Files Files and versions Community

omarmomen commited on Mar 26

Commit

8952578

•

1 Parent(s): 6f0ed27

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -17,4 +17,6 @@ The paper titled "Increasing The Performance of Cognitively Inspired Data-Effici
 This model variant places the parser network ahead of all the attention blocks.
-The model is pretrained on the BabyLM 10M dataset using a custom pretrained RobertaTokenizer (https://huggingface.co/omarmomen/babylm_tokenizer_32k).

 This model variant places the parser network ahead of all the attention blocks.
+The model is pretrained on the BabyLM 10M dataset using a custom pretrained RobertaTokenizer (https://huggingface.co/omarmomen/babylm_tokenizer_32k).
+https://arxiv.org/abs/2310.20589