01-ai

/

Yi-6B

like 364

Thank you for your question.

To help developers around the world better understand the context and to promote collaboration, I am responding to you in English.

1. modeling_yi.py has been removed. Instead, modeling_llama.py is used for inference.

2. NTK can be configured by setting the rope_scaling parameter at here.

Please let me know if you have any further concerns.

As it seems like your question has been answered, if there is nothing else we can help you with on this matter, we will be closing this discussion for now.

If you have any further questions, feel free to reopen this discussion or start a new one.

Thank you for your contribution to this community!