Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
CalmexperimentT3q-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
CalmexperimentT3q-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
85658f91b4ec2e8970092fabc215f02a562f6620811155dcbd28155685a2ab1c
cb2cd4f
verified
6 months ago
.gitattributes
2.27 kB
9049b5e804746ce8af3c92e89cd1c2043b3851786c61d69934b927431977bd48
6 months ago
CalmexperimentT3q-7B.Q2_K.gguf
2.72 GB
LFS
aa248d27d22040947ed199d031ec26e0f753ef58dca6b1f6cbb436950a85cf23
6 months ago
CalmexperimentT3q-7B.Q3_K_L.gguf
3.82 GB
LFS
03d76f76804a2e209919730d61dc6f4bcc2dce5cfff43292baa141fcc19483e8
6 months ago
CalmexperimentT3q-7B.Q3_K_M.gguf
3.52 GB
LFS
ffd7cb683fa468b565c498713938bcf50a494d54ed8001e1f301dd1e94d47e23
6 months ago
CalmexperimentT3q-7B.Q3_K_S.gguf
3.16 GB
LFS
5bc9c2735859aab29c1fe72d42871b6b8c94c0fd78d91dfb0276d84e66b4be7e
6 months ago
CalmexperimentT3q-7B.Q4_K_M.gguf
4.37 GB
LFS
a5b54271c33cf57eb6a1fc73c582104ad9ffd479de75a6308049dc2be1be3c2a
6 months ago
CalmexperimentT3q-7B.Q4_K_S.gguf
4.14 GB
LFS
50d1d2a3078ca0212790e5d1526c9a7b453ea3625fcd2399fd5400852816a0b9
6 months ago
CalmexperimentT3q-7B.Q5_K_M.gguf
5.13 GB
LFS
0f0f93211c3eb4253f3b89fa554299a193cffe55147c58116c1a87c48e2ae3a8
6 months ago
CalmexperimentT3q-7B.Q5_K_S.gguf
5 GB
LFS
a8ba61acb6fd1a8bff30ed15981c87dc645175c6b5c854625e36a302e69487b1
6 months ago
CalmexperimentT3q-7B.Q6_K.gguf
5.94 GB
LFS
5fbdb902269661c87ecff5bff1bd6d387180bc287b29c3e5e5d518d0c422a10e
6 months ago
CalmexperimentT3q-7B.Q8_0.gguf
7.7 GB
LFS
4ed9156a967e8881d7b6c4cd071e468f64e6ba8563069720819de6db2c04974e
6 months ago
CalmexperimentT3q-7B.fp16.gguf
14.5 GB
LFS
9049b5e804746ce8af3c92e89cd1c2043b3851786c61d69934b927431977bd48
6 months ago
README.md
3.24 kB
85658f91b4ec2e8970092fabc215f02a562f6620811155dcbd28155685a2ab1c
6 months ago