Hugging Face's logo

RWKV
/
rwkv-raven-1b5

Text Generation
Transformers
PyTorch
rwkv
Inference Endpoints
Model card Files Community
2
ybelkada commited on
Commit
6c9f3ed
•
1 Parent(s): 6a87d68

Update config.json

Browse files
Files changed (1) hide show
  1. config.json +2 -2
config.json CHANGED
@@ -4,9 +4,9 @@
4
  "RwkvForCausalLM"
5
  ],
6
  "attention_hidden_size": 2048,
7
- "bos_token_id": 0,
8
  "context_length": 1024,
9
- "eos_token_id": 2,
10
  "hidden_size": 2048,
11
  "intermediate_size": 8192,
12
  "layer_norm_epsilon": 1e-05,
 
4
  "RwkvForCausalLM"
5
  ],
6
  "attention_hidden_size": 2048,
7
+ "bos_token_id": 2,
8
  "context_length": 1024,
9
+ "eos_token_id": 0,
10
  "hidden_size": 2048,
11
  "intermediate_size": 8192,
12
  "layer_norm_epsilon": 1e-05,