恭喜！又一个精品，不过能提供gguf版本不？

by wukongai - opened Jan 28

Jan 28

gguf版本量化可以在cpu上运行，也可以选择部分权重加载到gpu上进行加速，对于我们这些消费级用户比较友好，谢谢！

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment