Text Generation
Transformers
PyTorch
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference
sam-mosaic udhavsethi commited on
Commit
925e0d8
1 Parent(s): 1fc4634

Add eos_token_id to generation config (#65)

Browse files

- Add eos_token_id to generation config (2c585a571b93e0c0a514896b0833142b56340897)


Co-authored-by: Udhav Sethi <udhavsethi@users.noreply.huggingface.co>

Files changed (1) hide show
  1. generation_config.json +1 -0
generation_config.json CHANGED
@@ -1,5 +1,6 @@
1
  {
2
  "_from_model_config": true,
3
  "transformers_version": "4.28.1",
 
4
  "use_cache": false
5
  }
 
1
  {
2
  "_from_model_config": true,
3
  "transformers_version": "4.28.1",
4
+ "eos_token_id": 0,
5
  "use_cache": false
6
  }