Upload sharded checkpoint

Fix incorrect dtypes of `attention.rotary_emb.inv_freq`, `attention.bias` and `attention.masked_bias`

Upload model card

Set `max_length` to 2048

Upload config files

Upload base files

initial commit