Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Calme-12B-Instruct-v0.1-GGUF
like
2
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Generated from Trainer
12b
calme
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
b2737ce
Calme-12B-Instruct-v0.1-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
7a1936a99ca4e3cf3cf8c13d0a6cdd178011a40450ab259e0bff456eca79ce19
b2737ce
verified
6 months ago
.gitattributes
2.38 kB
7a1936a99ca4e3cf3cf8c13d0a6cdd178011a40450ab259e0bff456eca79ce19
6 months ago
Calme-12B-Instruct-v0.1.IQ3_XS.gguf
5.16 GB
LFS
f7bf21d96435c2f5fb85988f8b2ba7709a3483176b234a5e4b3efd4fc849bb6b
6 months ago
Calme-12B-Instruct-v0.1.IQ4_XS.gguf
6.77 GB
LFS
a54f61c7dcd949832b110f6ceba32dfbbe02c4c525b1f4e738f4070e60b0fc62
6 months ago
Calme-12B-Instruct-v0.1.Q2_K.gguf
4.65 GB
LFS
48651a30ff589093e4f83046b78df5afa87bec4b1aeb8ea3ccf943e8b6a0bbf9
6 months ago
Calme-12B-Instruct-v0.1.Q3_K_L.gguf
6.57 GB
LFS
2e3b2b4c46e51f5bf668055965600a0a2d649bd63491fbaa04afb8d8613c6f40
6 months ago
Calme-12B-Instruct-v0.1.Q3_K_M.gguf
6.03 GB
LFS
4ebd79cf23af88f5e74cd6f45a726d2dfbcb13166331bafa12f47a3ab4275680
6 months ago
Calme-12B-Instruct-v0.1.Q3_K_S.gguf
5.41 GB
LFS
b69d949162173640d882e45ed45f419c682266b24f70e3fd51db1c4ce1e797be
6 months ago
Calme-12B-Instruct-v0.1.Q4_K_M.gguf
7.51 GB
LFS
3a79029db9010ac1c8e07c08d3f664463e2174b826c1ef490dfb391e5f4e0181
6 months ago
Calme-12B-Instruct-v0.1.Q4_K_S.gguf
7.11 GB
LFS
159cdff6001385271c57bffc07336e41ccec8386b6232ad1c561caf8ca10c037
6 months ago
Calme-12B-Instruct-v0.1.Q5_K_M.gguf
8.83 GB
LFS
c58c4b44d0a146fde1b3ee96303fcda785b860a99c99c0a86a5cdbab6cf8923e
6 months ago
Calme-12B-Instruct-v0.1.Q5_K_S.gguf
8.6 GB
LFS
e283cf5fe06e9faca116bfa34e459ea8d336d3cbe327337ea3699472615f45d0
6 months ago
Calme-12B-Instruct-v0.1.Q6_K.gguf
10.2 GB
LFS
e549f10b0ca84d20c5ddb2fd994634747768efb60c408ecfd1be8d0597ac1ff4
6 months ago
Calme-12B-Instruct-v0.1.Q8_0.gguf
13.3 GB
LFS
7a1936a99ca4e3cf3cf8c13d0a6cdd178011a40450ab259e0bff456eca79ce19
6 months ago
