Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

mradermacher
/

Phi-4-o1-i1-GGUF

chain-of-thought

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Phi-4-o1-i1-GGUF

1 contributor

History: 24 commits

mradermacher's picture

uploaded from marco

b3cd28e verified 27 days ago

.gitattributes

2.82 kB

uploaded from marco 27 days ago
Phi-4-o1.i1-IQ1_M.gguf

3.69 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-IQ1_S.gguf

3.41 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-IQ2_M.gguf

5.17 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-IQ2_S.gguf

4.8 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-IQ2_XS.gguf

4.56 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-IQ2_XXS.gguf

4.15 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-IQ3_M.gguf

6.74 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-IQ3_XXS.gguf

5.81 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-IQ4_NL.gguf

8.42 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-IQ4_XS.gguf

7.98 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-Q2_K.gguf

5.61 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-Q2_K_S.gguf

5.24 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-Q3_K_L.gguf

7.79 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-Q3_K_M.gguf

7.19 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-Q3_K_S.gguf

6.5 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-Q4_0.gguf

8.41 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-Q4_K_M.gguf

8.89 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-Q4_K_S.gguf

8.44 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-Q5_K_M.gguf

10.4 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-Q5_K_S.gguf

10.2 GB
LFS

uploaded from marco 27 days ago
Phi-4-o1.i1-Q6_K.gguf

12 GB
LFS

uploaded from marco 27 days ago
README.md

230 Bytes

uploaded from marco 27 days ago
imatrix.dat

7.79 MB
LFS

uploaded from marco 27 days ago