Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Phi-3-Context-Obedient-RAG-GGUF
like
4
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
phi3
conversational
custom_code
Inference Endpoints
text-generation-inference
License:
cc-by-sa-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
030a216
Phi-3-Context-Obedient-RAG-GGUF
1 contributor
History:
10 commits
MaziyarPanahi
cded3cf6dcd64a41007651efa15981f53e9023d63df04a1d1d7259aeb8a92e27
030a216
verified
about 2 months ago
.gitattributes
2.19 kB
cded3cf6dcd64a41007651efa15981f53e9023d63df04a1d1d7259aeb8a92e27
about 2 months ago
Phi-3-Context-Obedient-RAG.Q2_K.gguf
1.42 GB
LFS
0b3417ab82c083c3eb7deabcaa0bac1812774f58e5c2f0ffb69845b8ccd28136
about 2 months ago
Phi-3-Context-Obedient-RAG.Q3_K_L.gguf
2.09 GB
LFS
58c01dd032c4bdf16eaeb0f9d0086ee9cb5d413f19f887dc022a2f6b4eff890f
about 2 months ago
Phi-3-Context-Obedient-RAG.Q3_K_M.gguf
1.96 GB
LFS
0c602f1ca1edf5d5b7a4b47c1da8343b6ac111579f5953a71a1d6f9cd806c869
about 2 months ago
Phi-3-Context-Obedient-RAG.Q4_K_M.gguf
2.39 GB
LFS
5bd10eb16bde5f63d946d52a63aec28c1dcc01c4c0fdea6a52d17d3367c1bfae
about 2 months ago
Phi-3-Context-Obedient-RAG.Q4_K_S.gguf
2.19 GB
LFS
eba0747fc33ab9c20549b4ced91209cbe9b612994d9a230632885046272f8706
about 2 months ago
Phi-3-Context-Obedient-RAG.Q5_K_M.gguf
2.82 GB
LFS
568598357ea84c71e59a9a4419096423236b574d58f16a4a31bb82312a300fa4
about 2 months ago
Phi-3-Context-Obedient-RAG.Q5_K_S.gguf
2.64 GB
LFS
82e61277e6e45c57d7a5f794b85a5fa2f004ec5f6909268823f2753d98817cd9
about 2 months ago
Phi-3-Context-Obedient-RAG.Q6_K.gguf
3.14 GB
LFS
13c4b88ce036cc11f71273e954be9adb99ef4d3df794246e8a5b17620c31b51f
about 2 months ago
Phi-3-Context-Obedient-RAG.Q8_0.gguf
4.06 GB
LFS
cded3cf6dcd64a41007651efa15981f53e9023d63df04a1d1d7259aeb8a92e27
about 2 months ago
