Update README.md
Browse files
README.md
CHANGED
@@ -31,7 +31,7 @@ Other version: lower the expert to 2:
|
|
31 |
# You may want see this: https://huggingface.co/Alsebay/My_LLMs_Leaderboard
|
32 |
# It's ridiculous that I can run this original version in 4bit, but can't run in GGUF version. Maybe my GPU can't handle it?
|
33 |
|
34 |
-
Have try from Q2 to fp16, no hope. 😥
|
35 |
|
36 |
Link here: https://huggingface.co/Alsebay/HyouKan-GGUF
|
37 |
|
|
|
31 |
# You may want see this: https://huggingface.co/Alsebay/My_LLMs_Leaderboard
|
32 |
# It's ridiculous that I can run this original version in 4bit, but can't run in GGUF version. Maybe my GPU can't handle it?
|
33 |
|
34 |
+
Have try from Q2 to fp16, no hope. 😥 Seem that there is a bug in model pointer.
|
35 |
|
36 |
Link here: https://huggingface.co/Alsebay/HyouKan-GGUF
|
37 |
|