can't use llama load gguf model
2
#6 opened 2 months ago
by
Tianyi000
How to load this Mdoel in python
#5 opened 2 months ago
by
Bhupender100
How to use this model in Python
#4 opened 2 months ago
by
Ankit-TD
ollama failed to create model
3
#3 opened 3 months ago
by
edisonzf2020
Very sensitve to any repetition penalty!
2
#2 opened 3 months ago
by
jukofyork
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65995c45539c808e84c38bf1/FiU-p4LC6Ar0G2_1stO8d.png)
Reuse your `ggml-dbrx-instruct-16x12b-q8_0-imatrix.dat` file?
20
#1 opened 3 months ago
by
jukofyork
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65995c45539c808e84c38bf1/FiU-p4LC6Ar0G2_1stO8d.png)