启动加载很慢，需要130秒

by devillaws - opened Jul 28, 2023

Jul 28, 2023

启动加载很慢，需要130秒，这是什么原因

fb700

Owner Jul 28, 2023

正常如不需要量化应该在30秒，如果需要量化的确需要这么长时间

Jul 28, 2023

感谢解答，原来是因为我量化了

Jul 28, 2023

请问作者有打算出int4版本么

fb700

Owner Jul 28, 2023

量化后模型能力下降过多，体验不好。

fb700 changed discussion status to closed Jul 28, 2023

fb700 changed discussion status to open Aug 1, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment