bapatra philschmid HF staff commited on
Commit
9b3142d
1 Parent(s): ca22eff

Add attention_bias to make TGI work (#2)

Browse files

- Add attention_bias to make TGI work (652972d177235966d152591903e35bc67cbafcaf)
- Update config.json (837ed41f1324850fa0b859cd118c0be329575151)


Co-authored-by: Philipp Schmid <philschmid@users.noreply.huggingface.co>

Files changed (1) hide show
  1. config.json +1 -0
config.json CHANGED
@@ -31,5 +31,6 @@
31
  "torch_dtype": "bfloat16",
32
  "transformers_version": "4.39.3",
33
  "use_cache": true,
 
34
  "vocab_size": 32064
35
  }
 
31
  "torch_dtype": "bfloat16",
32
  "transformers_version": "4.39.3",
33
  "use_cache": true,
34
+ "attention_bias": false,
35
  "vocab_size": 32064
36
  }