Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
firefunction-v2-GGUF
like
14
Text Generation
Transformers
GGUF
Safetensors
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
function-calling
text-generation-inference
imatrix
License:
llama3
Model card
Files
Files and versions
Community
4
Train
Deploy
Use this model
66dd0e8
firefunction-v2-GGUF
1 contributor
History:
14 commits
MaziyarPanahi
7e77b0257146c6bc23e1307aaa8d329beefffab1a524ed83986c84614c0402b2
66dd0e8
verified
5 months ago
.gitattributes
Safe
2.28 kB
7e77b0257146c6bc23e1307aaa8d329beefffab1a524ed83986c84614c0402b2
5 months ago
README.md
Safe
4.52 kB
Update README.md (#1)
5 months ago
firefunction-v2.IQ1_M.gguf
Safe
16.8 GB
LFS
b166a720114b045cdc5ac5a9771c7fa0ddc897af3e5dc688b467b2885c066d40
5 months ago
firefunction-v2.IQ1_S.gguf
Safe
15.3 GB
LFS
5dfc3d12d3b49fb5a6443715e08b3bb6be62d91392edf59cbdaefd64dbddb0bb
5 months ago
firefunction-v2.IQ2_XS.gguf
Safe
21.1 GB
LFS
f35702f7a0065a003c798b38a4fcf73635e1d062383fdb507d93d661b2e8a11d
5 months ago
firefunction-v2.IQ3_XS.gguf
Safe
29.3 GB
LFS
95dc2f18845a7c19788b69d10929a88a825d944e1b6bdea10220dac091f26644
5 months ago
firefunction-v2.IQ4_XS.gguf
Safe
37.9 GB
LFS
8d86dd32f4ee3eba588da7ed574b7eca6c7776c107431792c7308cd3dfb0f35d
5 months ago
firefunction-v2.Q2_K.gguf
Safe
26.4 GB
LFS
eb16eb0e46dde03d6628324b4ba6ac8196f25068201857a75f48569bc5095ee9
5 months ago
firefunction-v2.Q3_K_L.gguf
Safe
37.1 GB
LFS
f5e53d985b7f97a574a811717047b755821effd309ce4b4c6760cab012c9e210
5 months ago
firefunction-v2.Q3_K_M.gguf
Safe
34.3 GB
LFS
c1d4d5d57a07a0e8ecced81cc68682d1c7af94149c68622e3a6adfce9dc33aad
5 months ago
firefunction-v2.Q3_K_S.gguf
Safe
30.9 GB
LFS
25968f2f66b322c495bcd410366d854036ab7227205a5d565bdd91c65deda521
5 months ago
firefunction-v2.Q4_K_M.gguf
Safe
42.5 GB
LFS
a2458dced4ee1a22f0bb09bce1a51f760ca1fbd9bab47e38d2a81133421a19d6
5 months ago
firefunction-v2.Q4_K_S.gguf
Safe
40.3 GB
LFS
a5e133afb431c4d01d138d794a4601c9cf60a7e2bc587d8fef8650b244bab721
5 months ago
firefunction-v2.Q5_K_M.gguf
Safe
49.9 GB
LFS
7e77b0257146c6bc23e1307aaa8d329beefffab1a524ed83986c84614c0402b2
5 months ago