Update README.md

README.md

@@ -3,31 +3,29 @@ base_model: state-spaces/mamba-130m-hf
 tags:
 - generated_from_trainer
 model-index:
-- name: trainer
+- name: monsoon-nlp/mamba130-proteinpretrain-quinoa
   results: []
+datasets:
+- monsoon-nlp/greenbeing-proteins
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
+# mamba130-proteinpretrain-quinoa
 
-# trainer
+Full model finetuning of Mamba-130M-HF on the "research" split (quinoa 
+protein sequences) of GreenBeing-Proteins dataset.
 
-This model is a fine-tuned version of [state-spaces/mamba-130m-hf](https://huggingface.co/state-spaces/mamba-130m-hf) on an unknown dataset.
+Due to limits of V100 GPU, trained 510 steps x batches of 3, ~5% of the research split.
 
-## Model description
+Requires GitHub main branch of Transformers (Mamba is not included in releases)
 
-More information needed
+Considering training on natural language + proteins, or new "biotokens".
 
-## Intended uses & limitations
-
-More information needed
-
-## Training and evaluation data
-
-More information needed
+More details TBD
 
 ## Training procedure
 
+Notebook: https://colab.research.google.com/drive/1W1rB6rRt8krHZSVYQ_TjbnD9OwzFQeGL
+
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
@@ -45,4 +43,4 @@ The following hyperparameters were used during training:
 - Transformers 4.40.0.dev0
 - Pytorch 2.2.1+cu121
 - Datasets 2.18.0
-- Tokenizers 0.15.2
+- Tokenizers 0.15.2