Text Generation
Transformers
PyTorch
English
btlm
causal-lm
Cerebras
BTLM
custom_code
avishnevskiy commited on
Commit
e67d01b
1 Parent(s): 44fe47d

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. config.json +1 -1
  2. pytorch_model.bin +3 -0
config.json CHANGED
@@ -34,7 +34,7 @@
34
  "resid_pdrop": 0.0,
35
  "scale_attn_by_inverse_layer_idx": false,
36
  "scale_attn_weights": true,
37
- "torch_dtype": "float32",
38
  "transformers_version": "4.34.1",
39
  "use_cache": true,
40
  "vocab_size": 50257
 
34
  "resid_pdrop": 0.0,
35
  "scale_attn_by_inverse_layer_idx": false,
36
  "scale_attn_weights": true,
37
+ "torch_dtype": "bfloat16",
38
  "transformers_version": "4.34.1",
39
  "use_cache": true,
40
  "vocab_size": 50257
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:701708315fcd3abe6f6243770407b485fa6ed85c006ee2601af11a97c9f727f3
3
+ size 5292652837