Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
ChatMusician-GGUF
like
11
Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
en
arxiv:2402.16153
Inference Endpoints
text-generation-inference
License:
mit
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
8b1aa70
ChatMusician-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
97ff0c7ce98224eae6dbaff44bb1b1b2d5b3344adb956ffbcee165a5ee9be974
8b1aa70
verified
4 months ago
.gitattributes
2.12 kB
16c163d5934deb9eaef07d620b7decd9a8f60bfc5dd38e95a5fdf41a34fab2f4
4 months ago
ChatMusician.Q2_K.gguf
2.53 GB
LFS
94edf840f50f3977600b3d71df72106390471b38b7f149ccc3cd7afd089a7829
4 months ago
ChatMusician.Q3_K_L.gguf
3.6 GB
LFS
7fa0d4f2628cb046e083b576a8b5ad998e43a4816eeac23272f19c68e1e85811
4 months ago
ChatMusician.Q3_K_M.gguf
3.3 GB
LFS
fa3910b2ab41919b34d6979feee07854ba7beb26abb099d8b131c11c00fc57db
4 months ago
ChatMusician.Q3_K_S.gguf
2.95 GB
LFS
a64b2541622923114895bcd77dd4b0cb41a7b501582495815bfa7edc073ea6f7
4 months ago
ChatMusician.Q4_K_M.gguf
4.08 GB
LFS
f64434c7730337935a1e726ddc7831db16f850d0f979e9dc700602de4e1bd7a5
4 months ago
ChatMusician.Q4_K_S.gguf
3.86 GB
LFS
f162b5c49b9960c3439b17a326a72e64df85fe35d7e16cb0abac0cb66b830cdd
4 months ago
ChatMusician.Q5_K_M.gguf
4.78 GB
LFS
d6d995704ba3dae491063029ec0bccf5971e0ab88ce02f17629bdd86ae458a65
4 months ago
ChatMusician.Q5_K_S.gguf
4.65 GB
LFS
a7181b07e33b58395cb036f7822d39a33f19ea8f79fe222a1e4e398483210bb7
4 months ago
ChatMusician.Q6_K.gguf
5.53 GB
LFS
7b03f073d6e62402f659ee87c6ca698e363bb0b7252575bb4a7445888a43fe4a
4 months ago
ChatMusician.Q8_0.gguf
7.16 GB
LFS
16c163d5934deb9eaef07d620b7decd9a8f60bfc5dd38e95a5fdf41a34fab2f4
4 months ago
README.md
10.7 kB
97ff0c7ce98224eae6dbaff44bb1b1b2d5b3344adb956ffbcee165a5ee9be974
4 months ago
