References

For more information, please refer to our paper and GitHub repository.

Paper: Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation

GitHub: BiPE

Authors: Zhenyu He*, Guhao Feng*, Shengjie Luo*, Kai Yang, Di He, Jingjing Xu, Zhi Zhang, Hongxia Yang, Liwei Wang

Downloads last month
2
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support