Hugging Face's logo

featherless-ai-quants
/
Sao10K-Fimbulvetr-11B-v2-GGUF

Text Generation
GGUF
Inference Endpoints
Model card Files Community
m8than commited on
Commit
689e838
•
1 Parent(s): 5fbf7da

Upload folder using huggingface_hub

Browse files
Files changed (23) hide show
  1. .gitattributes +21 -0
  2. README.md +46 -0
  3. Sao10K-Fimbulvetr-11B-v2-IQ4_XS/Sao10K-Fimbulvetr-11B-v2-IQ4_XS-00001-of-00002.gguf +3 -0
  4. Sao10K-Fimbulvetr-11B-v2-IQ4_XS/Sao10K-Fimbulvetr-11B-v2-IQ4_XS-00002-of-00002.gguf +3 -0
  5. Sao10K-Fimbulvetr-11B-v2-Q2_K.gguf +3 -0
  6. Sao10K-Fimbulvetr-11B-v2-Q3_K_L/Sao10K-Fimbulvetr-11B-v2-Q3_K_L-00001-of-00002.gguf +3 -0
  7. Sao10K-Fimbulvetr-11B-v2-Q3_K_L/Sao10K-Fimbulvetr-11B-v2-Q3_K_L-00002-of-00002.gguf +3 -0
  8. Sao10K-Fimbulvetr-11B-v2-Q3_K_M.gguf +3 -0
  9. Sao10K-Fimbulvetr-11B-v2-Q3_K_S.gguf +3 -0
  10. Sao10K-Fimbulvetr-11B-v2-Q4_K_M/Sao10K-Fimbulvetr-11B-v2-Q4_K_M-00001-of-00002.gguf +3 -0
  11. Sao10K-Fimbulvetr-11B-v2-Q4_K_M/Sao10K-Fimbulvetr-11B-v2-Q4_K_M-00002-of-00002.gguf +3 -0
  12. Sao10K-Fimbulvetr-11B-v2-Q4_K_S/Sao10K-Fimbulvetr-11B-v2-Q4_K_S-00001-of-00002.gguf +3 -0
  13. Sao10K-Fimbulvetr-11B-v2-Q4_K_S/Sao10K-Fimbulvetr-11B-v2-Q4_K_S-00002-of-00002.gguf +3 -0
  14. Sao10K-Fimbulvetr-11B-v2-Q5_K_M/Sao10K-Fimbulvetr-11B-v2-Q5_K_M-00001-of-00002.gguf +3 -0
  15. Sao10K-Fimbulvetr-11B-v2-Q5_K_M/Sao10K-Fimbulvetr-11B-v2-Q5_K_M-00002-of-00002.gguf +3 -0
  16. Sao10K-Fimbulvetr-11B-v2-Q5_K_S/Sao10K-Fimbulvetr-11B-v2-Q5_K_S-00001-of-00002.gguf +3 -0
  17. Sao10K-Fimbulvetr-11B-v2-Q5_K_S/Sao10K-Fimbulvetr-11B-v2-Q5_K_S-00002-of-00002.gguf +3 -0
  18. Sao10K-Fimbulvetr-11B-v2-Q6_K/Sao10K-Fimbulvetr-11B-v2-Q6_K-00001-of-00002.gguf +3 -0
  19. Sao10K-Fimbulvetr-11B-v2-Q6_K/Sao10K-Fimbulvetr-11B-v2-Q6_K-00002-of-00002.gguf +3 -0
  20. Sao10K-Fimbulvetr-11B-v2-Q8_0/Sao10K-Fimbulvetr-11B-v2-Q8_0-00001-of-00003.gguf +3 -0
  21. Sao10K-Fimbulvetr-11B-v2-Q8_0/Sao10K-Fimbulvetr-11B-v2-Q8_0-00002-of-00003.gguf +3 -0
  22. Sao10K-Fimbulvetr-11B-v2-Q8_0/Sao10K-Fimbulvetr-11B-v2-Q8_0-00003-of-00003.gguf +3 -0
  23. featherless-quants.png +3 -0
.gitattributes CHANGED
@@ -33,3 +33,24 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Sao10K-Fimbulvetr-11B-v2-IQ4_XS/Sao10K-Fimbulvetr-11B-v2-IQ4_XS-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Sao10K-Fimbulvetr-11B-v2-IQ4_XS/Sao10K-Fimbulvetr-11B-v2-IQ4_XS-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Sao10K-Fimbulvetr-11B-v2-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Sao10K-Fimbulvetr-11B-v2-Q3_K_L/Sao10K-Fimbulvetr-11B-v2-Q3_K_L-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Sao10K-Fimbulvetr-11B-v2-Q3_K_L/Sao10K-Fimbulvetr-11B-v2-Q3_K_L-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Sao10K-Fimbulvetr-11B-v2-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Sao10K-Fimbulvetr-11B-v2-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Sao10K-Fimbulvetr-11B-v2-Q4_K_M/Sao10K-Fimbulvetr-11B-v2-Q4_K_M-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Sao10K-Fimbulvetr-11B-v2-Q4_K_M/Sao10K-Fimbulvetr-11B-v2-Q4_K_M-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Sao10K-Fimbulvetr-11B-v2-Q4_K_S/Sao10K-Fimbulvetr-11B-v2-Q4_K_S-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Sao10K-Fimbulvetr-11B-v2-Q4_K_S/Sao10K-Fimbulvetr-11B-v2-Q4_K_S-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Sao10K-Fimbulvetr-11B-v2-Q5_K_M/Sao10K-Fimbulvetr-11B-v2-Q5_K_M-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Sao10K-Fimbulvetr-11B-v2-Q5_K_M/Sao10K-Fimbulvetr-11B-v2-Q5_K_M-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Sao10K-Fimbulvetr-11B-v2-Q5_K_S/Sao10K-Fimbulvetr-11B-v2-Q5_K_S-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Sao10K-Fimbulvetr-11B-v2-Q5_K_S/Sao10K-Fimbulvetr-11B-v2-Q5_K_S-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Sao10K-Fimbulvetr-11B-v2-Q6_K/Sao10K-Fimbulvetr-11B-v2-Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Sao10K-Fimbulvetr-11B-v2-Q6_K/Sao10K-Fimbulvetr-11B-v2-Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Sao10K-Fimbulvetr-11B-v2-Q8_0/Sao10K-Fimbulvetr-11B-v2-Q8_0-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Sao10K-Fimbulvetr-11B-v2-Q8_0/Sao10K-Fimbulvetr-11B-v2-Q8_0-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Sao10K-Fimbulvetr-11B-v2-Q8_0/Sao10K-Fimbulvetr-11B-v2-Q8_0-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
56
+ featherless-quants.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Sao10K/Fimbulvetr-11B-v2
3
+ pipeline_tag: text-generation
4
+ quantized_by: featherless-ai-quants
5
+ ---
6
+
7
+ # Sao10K/Fimbulvetr-11B-v2 GGUF Quantizations 🚀
8
+
9
+ ![Featherless AI Quants](./featherless-quants.png)
10
+
11
+ *Optimized GGUF quantization files for enhanced model performance*
12
+
13
+ ---
14
+
15
+ ## Available Quantizations 📊
16
+
17
+ | Quantization Type | File | Size |
18
+ |-------------------|------|------|
19
+ | Q8_0 | [Sao10K-Fimbulvetr-11B-v2-Q8_0](https://huggingface.co/featherless-ai-quants/Sao10K-Fimbulvetr-11B-v2-GGUF/tree/main/Sao10K-Fimbulvetr-11B-v2-Q8_0) | 10875.85 MB |
20
+ | Q4_K_S | [Sao10K-Fimbulvetr-11B-v2-Q4_K_S](https://huggingface.co/featherless-ai-quants/Sao10K-Fimbulvetr-11B-v2-GGUF/tree/main/Sao10K-Fimbulvetr-11B-v2-Q4_K_S) | 5835.08 MB |
21
+ | Q2_K | [Sao10K-Fimbulvetr-11B-v2-Q2_K.gguf](https://huggingface.co/featherless-ai-quants/Sao10K-Fimbulvetr-11B-v2-GGUF/tree/main/Sao10K-Fimbulvetr-11B-v2-Q2_K.gguf) | 3817.78 MB |
22
+ | Q6_K | [Sao10K-Fimbulvetr-11B-v2-Q6_K](https://huggingface.co/featherless-ai-quants/Sao10K-Fimbulvetr-11B-v2-GGUF/tree/main/Sao10K-Fimbulvetr-11B-v2-Q6_K) | 8397.30 MB |
23
+ | Q3_K_M | [Sao10K-Fimbulvetr-11B-v2-Q3_K_M.gguf](https://huggingface.co/featherless-ai-quants/Sao10K-Fimbulvetr-11B-v2-GGUF/tree/main/Sao10K-Fimbulvetr-11B-v2-Q3_K_M.gguf) | 4954.98 MB |
24
+ | Q3_K_S | [Sao10K-Fimbulvetr-11B-v2-Q3_K_S.gguf](https://huggingface.co/featherless-ai-quants/Sao10K-Fimbulvetr-11B-v2-GGUF/tree/main/Sao10K-Fimbulvetr-11B-v2-Q3_K_S.gguf) | 4448.48 MB |
25
+ | Q3_K_L | [Sao10K-Fimbulvetr-11B-v2-Q3_K_L](https://huggingface.co/featherless-ai-quants/Sao10K-Fimbulvetr-11B-v2-GGUF/tree/main/Sao10K-Fimbulvetr-11B-v2-Q3_K_L) | 5388.98 MB |
26
+ | Q4_K_M | [Sao10K-Fimbulvetr-11B-v2-Q4_K_M](https://huggingface.co/featherless-ai-quants/Sao10K-Fimbulvetr-11B-v2-GGUF/tree/main/Sao10K-Fimbulvetr-11B-v2-Q4_K_M) | 6162.33 MB |
27
+ | Q5_K_S | [Sao10K-Fimbulvetr-11B-v2-Q5_K_S](https://huggingface.co/featherless-ai-quants/Sao10K-Fimbulvetr-11B-v2-GGUF/tree/main/Sao10K-Fimbulvetr-11B-v2-Q5_K_S) | 7054.70 MB |
28
+ | Q5_K_M | [Sao10K-Fimbulvetr-11B-v2-Q5_K_M](https://huggingface.co/featherless-ai-quants/Sao10K-Fimbulvetr-11B-v2-GGUF/tree/main/Sao10K-Fimbulvetr-11B-v2-Q5_K_M) | 7245.95 MB |
29
+ | IQ4_XS | [Sao10K-Fimbulvetr-11B-v2-IQ4_XS](https://huggingface.co/featherless-ai-quants/Sao10K-Fimbulvetr-11B-v2-GGUF/tree/main/Sao10K-Fimbulvetr-11B-v2-IQ4_XS) | 5557.67 MB |
30
+
31
+
32
+ ---
33
+
34
+ ## ⚡ Powered by [Featherless AI](https://featherless.ai)
35
+
36
+ ### Key Features
37
+
38
+ - 🔥 **Instant Hosting** - Deploy any Llama model on HuggingFace instantly
39
+ - 🛠️ **Zero Infrastructure** - No server setup or maintenance required
40
+ - 📚 **Vast Compatibility** - Support for 2400+ models and counting
41
+ - 💎 **Affordable Pricing** - Starting at just $10/month
42
+
43
+ ---
44
+
45
+ **Links:**
46
+ [Get Started](https://featherless.ai) | [Documentation](https://featherless.ai/docs) | [Models](https://featherless.ai/models)
Sao10K-Fimbulvetr-11B-v2-IQ4_XS/Sao10K-Fimbulvetr-11B-v2-IQ4_XS-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:500f9942a542ea5d1ab493ec4a7b7521e29291b1fb90695299890b12b658d1c0
3
+ size 5000055904
Sao10K-Fimbulvetr-11B-v2-IQ4_XS/Sao10K-Fimbulvetr-11B-v2-IQ4_XS-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a61f75b795f6795ffa9fdcad8cd757b1672b1371b1ad93eac5ac192415c88740
3
+ size 827584064
Sao10K-Fimbulvetr-11B-v2-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:669d968e3f1166abc7ec6d9644a235e83486e6d4ad8e3134c4f39e5268c84014
3
+ size 4003232224
Sao10K-Fimbulvetr-11B-v2-Q3_K_L/Sao10K-Fimbulvetr-11B-v2-Q3_K_L-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf6d7cabc64752bf93193a7908a8d141a86a27f0dfd36b8309200f88b68057d2
3
+ size 4971753344
Sao10K-Fimbulvetr-11B-v2-Q3_K_L/Sao10K-Fimbulvetr-11B-v2-Q3_K_L-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88ea0062281e51fda9ca4839091ce3d18a7c6cc527208696fd12c37e8fb01c67
3
+ size 678996768
Sao10K-Fimbulvetr-11B-v2-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:886eb7d781c0b1a44abba3e34e5eaf7f0a156f1221d6e62f4d4772b639c5f1e9
3
+ size 5195667936
Sao10K-Fimbulvetr-11B-v2-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f097afd1bbe0456a5d3fbd090b7dcb47983557af2729334fbb7858cae56f424
3
+ size 4664564192
Sao10K-Fimbulvetr-11B-v2-Q4_K_M/Sao10K-Fimbulvetr-11B-v2-Q4_K_M-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02cf11ec5c1177c5b501d9abae1bca06dc47a657da14ea9f7540dbb32593852e
3
+ size 4997219584
Sao10K-Fimbulvetr-11B-v2-Q4_K_M/Sao10K-Fimbulvetr-11B-v2-Q4_K_M-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e3eefb017ecc6762f9069b35d5da4593fddc26f3adc96e93486a554e48cd794
3
+ size 1464448416
Sao10K-Fimbulvetr-11B-v2-Q4_K_S/Sao10K-Fimbulvetr-11B-v2-Q4_K_S-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b96b124e8ca49f5b482c4294f4fb36cc756f2e32024fba5ed41fd44d54fd19a4
3
+ size 4972611456
Sao10K-Fimbulvetr-11B-v2-Q4_K_S/Sao10K-Fimbulvetr-11B-v2-Q4_K_S-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34fdb92c769b3eda1378697acdf0eb0b80dc5146118575c58ba2e99fe107116e
3
+ size 1145910048
Sao10K-Fimbulvetr-11B-v2-Q5_K_M/Sao10K-Fimbulvetr-11B-v2-Q5_K_M-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60a7bc9f86760585e52f976e55b87816128755f7c87eb18fbdd90c6c854bc9fd
3
+ size 4992743328
Sao10K-Fimbulvetr-11B-v2-Q5_K_M/Sao10K-Fimbulvetr-11B-v2-Q5_K_M-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d4eaa6ea5ad7f0ea5cdf7acb3b8636358eae153e1a55ab7829c1d4410910f8c
3
+ size 2605187840
Sao10K-Fimbulvetr-11B-v2-Q5_K_S/Sao10K-Fimbulvetr-11B-v2-Q5_K_S-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b4504946452ab91d7f7a3b60ad9598486a0e4dc8917e986be28ea45036231ad
3
+ size 4970936544
Sao10K-Fimbulvetr-11B-v2-Q5_K_S/Sao10K-Fimbulvetr-11B-v2-Q5_K_S-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b4098564dd1fb40f8c098b8b2cf6a2925bf2747017ef68b1cd58641212122cf
3
+ size 2426454464
Sao10K-Fimbulvetr-11B-v2-Q6_K/Sao10K-Fimbulvetr-11B-v2-Q6_K-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64479eaceef14bdfe8098a54b39c82b8c7d1f2132ea1a4be93a5048b8ce4ea11
3
+ size 4987981344
Sao10K-Fimbulvetr-11B-v2-Q6_K/Sao10K-Fimbulvetr-11B-v2-Q6_K-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9058da05dd2c6ab04aa7aeb905ca8d6451551d0d8772082fd1cbd355c31ccffc
3
+ size 3817229440
Sao10K-Fimbulvetr-11B-v2-Q8_0/Sao10K-Fimbulvetr-11B-v2-Q8_0-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5505ebeeec2bcd76b594b046f6f00ff9b1130cf079f2503d0c212f4a42ac124
3
+ size 4984840320
Sao10K-Fimbulvetr-11B-v2-Q8_0/Sao10K-Fimbulvetr-11B-v2-Q8_0-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b6f45bbbeca7fb4578dec22329f403f9de528d660645842efd37b7b0e36c20e
3
+ size 4951829888
Sao10K-Fimbulvetr-11B-v2-Q8_0/Sao10K-Fimbulvetr-11B-v2-Q8_0-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d98556801e0633a2c6546da68e030cc6d14962709cca4eedeb6148deedbd9226
3
+ size 1467485440
featherless-quants.png ADDED

Git LFS Details

  • SHA256: 2e1b4d66c8306c7b0614089381fdf86ea4efb02dffb78d22767a084cb8b88d6b
  • Pointer size: 132 Bytes
  • Size of remote file: 1.61 MB