BramVanroy
/

falcon-7b-ft-alpaca-cleaned-dutch

Text Generation

text-generation-inference

Model card Files Files and versions Community

Bram Vanroy commited on Dec 5, 2023

Commit

d903de4

•

1 Parent(s): 93676c8

Revert "Update config.json"

This reverts commit 93676c8d0cf6162bc2314c3377d5aaa0fe7fafe0.

Files changed (1) hide show

config.json +0 -1

config.json CHANGED Viewed

@@ -17,7 +17,6 @@
   "layer_norm_epsilon": 1e-05,
   "num_attention_heads": 71,
   "num_hidden_layers": 32,
-  "num_kv_heads": 3,
   "parallel_attn": true,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.2",

   "layer_norm_epsilon": 1e-05,
   "num_attention_heads": 71,
   "num_hidden_layers": 32,
   "parallel_attn": true,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.2",