YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Celerity 271m 8K — rd_0.1_cbcore2.6.0
Official Celerity 271m residual-dropout checkpoint converted from Cerebras CS format to Hugging Face format.
Training provenance
- Original experiment:
rd_0.1_cbcore2.6.0 - Source checkpoint:
checkpoint_13773.mdl - Residual dropout rate: 0.1
- Residual dropout schedule: constant residual dropout
- Attention dropout rate: 0.0
- Stochastic depth: 0.0
- LayerDrop: 0.0
- Converter commit:
6f36ba6d76a97383171df68af096670b64f718b7
Residual dropout is a training-time regularizer. Its effect is represented in
the learned model weights; Hugging Face evaluation is performed with dropout
disabled in model.eval().
This repository uses custom Celerity Hugging Face modeling code and should be
loaded with trust_remote_code=True.
- Downloads last month
- 13
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support