Intermediate_size is doubled in config.json
#3
by
hafezmg48
- opened
Why In the qwen 1.8B, the intermediate_size is given as 11008 in the config.json file whereas the mlp dimensions are 5504?
Also why the vocab_size is 151936 in the model but in the model card it is mentioned as 151851?