Hugging Face's logo

Spaces:
Corianas
/
RamblingGPT
Paused

App Files Community
1
Corianas commited on
Commit
5b13017
•
1 Parent(s): c9f8963

Lower the max tokens.

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -29,7 +29,7 @@ def add_caseifer(text):
29
  new_text += char
30
  return new_text
31
 
32
- max_new_tokens = 175 # number of tokens generated in each sample
33
  temperature = 0.8 # 1.0 = no change, < 1.0 = less random, > 1.0 = more random, in predictions
34
  top_k = 200 # retain only the top_k most likely tokens, clamp others to have 0 probability
35
  device = 'cpu' # examples: 'cpu', 'cuda', 'cuda:0', 'cuda:1', etc.
 
29
  new_text += char
30
  return new_text
31
 
32
+ max_new_tokens = 88 # number of tokens generated in each sample
33
  temperature = 0.8 # 1.0 = no change, < 1.0 = less random, > 1.0 = more random, in predictions
34
  top_k = 200 # retain only the top_k most likely tokens, clamp others to have 0 probability
35
  device = 'cpu' # examples: 'cpu', 'cuda', 'cuda:0', 'cuda:1', etc.