abhinavkulkarni
/

tiiuae-falcon-40b-instruct-w4-g128-awq

Text Generation

text-generation-inference

Model card Files Files and versions Community

abhinavkulkarni commited on Sep 7, 2023

Commit

b8dc80e

•

1 Parent(s): 987b81f

Upload config

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -22,7 +22,7 @@
   "n_head_kv": 8,
   "n_layer": 60,
   "parallel_attn": true,
-  "torch_dtype": "bfloat16",
   "transformers_version": "4.33.1",
   "use_cache": true,
   "vocab_size": 65024

   "n_head_kv": 8,
   "n_layer": 60,
   "parallel_attn": true,
+  "torch_dtype": "float16",
   "transformers_version": "4.33.1",
   "use_cache": true,
   "vocab_size": 65024