RMSNorm eps value is wrong
#19
by
qnixsynapse
- opened
The RMSNorm eps value in this model is wrong because of an error on the official HF repository which has been fixed. It's a request to please upload with the correct RMSNorm eps for better output quality.
For more information, please see here: https://github.com/facebookresearch/llama/issues/771