Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
LlaMAndement-7b-GGUF
like
0
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
llama-2
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
LlaMAndement-7b-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
0bcac5179d9ec6a5d3915c81aae744e3b427e05e721476bd800dc585fa5362f5
21087d3
verified
4 months ago
.gitattributes
2.15 kB
34d9f9eecfa40d80f553f1f3078d5ebcb9fc9087746023273989af0dadd51088
4 months ago
LlaMAndement-7b.Q2_K.gguf
2.53 GB
LFS
53004609ec77bbbf5ba89f07a793f40944536d038df33d4b12daec86743d11d4
4 months ago
LlaMAndement-7b.Q3_K_L.gguf
3.6 GB
LFS
13d4d039230acf22e5007d44a5d72a00730105caf44ec4f01e013a187b3d443b
4 months ago
LlaMAndement-7b.Q3_K_M.gguf
3.3 GB
LFS
cb312612fd6fd8836b180e78948836fb4130cd58531ae675b4877b832aa61695
4 months ago
LlaMAndement-7b.Q3_K_S.gguf
2.95 GB
LFS
0fe71544df09081b9333142a95268fbbd9ad694f5e66ee3e0f564d996e61feea
4 months ago
LlaMAndement-7b.Q4_K_M.gguf
4.08 GB
LFS
65e19c5b9ca4ef790dc1f2ed851c714fa15b70a25e558abe27bf034a7d874648
4 months ago
LlaMAndement-7b.Q4_K_S.gguf
3.86 GB
LFS
bbd45c47ba803a9b4beec9ea3564d55c9f792bad4d3b53ace6d81f80295052c1
4 months ago
LlaMAndement-7b.Q5_K_M.gguf
4.78 GB
LFS
ca072becb412e29c20a62b205eeec81d2a6308db449835a9ee215d70401bdb54
4 months ago
LlaMAndement-7b.Q5_K_S.gguf
4.65 GB
LFS
0eac4dcd1123e2ae3f41514b6c979b10cd1c1f1d28fc38fbc91f94220e3ee06a
4 months ago
LlaMAndement-7b.Q6_K.gguf
5.53 GB
LFS
fe78640674d0f9f9f565dab130a49ce620ab896882eb419e2482ce7c4d749533
4 months ago
LlaMAndement-7b.Q8_0.gguf
7.16 GB
LFS
34d9f9eecfa40d80f553f1f3078d5ebcb9fc9087746023273989af0dadd51088
4 months ago
README.md
2.97 kB
0bcac5179d9ec6a5d3915c81aae744e3b427e05e721476bd800dc585fa5362f5
4 months ago
