feat(transformers): Add native Transformers config
What does this PR do?
→ Sets model_type from new to gte and adds rope_parameters, so the checkpoint loads directly with AutoModel / AutoConfig in Transformers 🤗 without trust_remote_code.
→ Transformers support is being added in https://github.com/huggingface/transformers/pull/48416
→ ⚠️ Please hold this until the Transformers PR above has landed 🤗
Compatibility
→ rope_scaling, rope_theta and auto_map are left untouched, so nothing changes for anyone on an older version.
Produced by?
→ rope_parameters is the standardised form of the existing rope_theta. This checkpoint leaves rope_scaling at null, so the standardised form is a plain default rope with the same base.
→ Outputs are reproduced against the original implementation on this checkpoint (max relative difference 3.0e-06), and the checkpoint is covered by the parity harness in the Transformers PR.