nasa-impact
/

nasa-smd-ibm-v0.1

Inference Endpoints

Model card Files Files and versions Community

Muthukumaran commited on Feb 20

Commit

857e8f7

•

1 Parent(s): 2609f8e

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -19,6 +19,7 @@ nasa-smd-ibm-v0.1 is a RoBERTa-based, Encoder-only transformer model, domain-ada
 - **Tokenizer**: Custom
 - **Parameters**: 125M
 - **Pretraining Strategy**: Masked Language Modeling (MLM)
 ## Training Data
 - Wikipedia English (Feb 1, 2020)

 - **Tokenizer**: Custom
 - **Parameters**: 125M
 - **Pretraining Strategy**: Masked Language Modeling (MLM)
+- **Distilled Version**: You can download a distilled version of the model (30 Million Parameters) here: https://drive.google.com/file/d/19s2Vv9WlmlRhh_AhzdP-s__0spQCG8cQ/view?usp=sharing
 ## Training Data
 - Wikipedia English (Feb 1, 2020)