Update LayerNorm tensor names to weight and bias (from gamma and beta)

#70
No description provided.
gabrielmbmb changed pull request title from LayerNorm tensors should be called weight and bias to Update LayerNorm tensor names to weight and bias (from gamma and beta)

This PR updates model.safetensors file to update the name of the tensors of LayerNorm that are still named as gamma and beta. This change is motivated because the rest of the tensors follows the naming convention of weight and bias. In addition, when using PreTrainedModel.push_to_hub method, all the tensors in the created model.safetensors are named weight and bias.

gabrielmbmb changed pull request status to open
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment