Create README.md

This model is part of the experiments in my master's thesis titled "Linguistic Structure Induction from Language Models" (https://arxiv.org/abs/2403.09714).

"omarmomen/tf_babylm_1" is the Vanilla Transformer (TF) referred to in Chapter 5 (p. 59); it is a transformer encoder model.

The model is trained on the BabyLM 10M dataset, with a RobertaTokenizer pretrained on the BabyLM 10M dataset with 16K tokens.

README.md

@@ -0,0 +1,11 @@
+---
+license: mit
+datasets:
+- omarmomen/babylm_10M
+language:
+- en
+metrics:
+- perplexity
+library_name: transformers
+pipeline_tag: fill-mask
+---