Update layer norm eps

#2
by nielsr HF staff - opened

This PR updates the layernorm epsilon value to reflect the original implementation.

This was tested with @ydshieh and integration tests are not affected (logits still match).

ybelkada changed pull request status to merged

Sign up or log in to comment