Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+RLHFlow-LLaMA3-SFT-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+RLHFlow-LLaMA3-SFT-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+RLHFlow-LLaMA3-SFT-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+RLHFlow-LLaMA3-SFT-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+RLHFlow-LLaMA3-SFT-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+RLHFlow-LLaMA3-SFT-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+RLHFlow-LLaMA3-SFT-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+RLHFlow-LLaMA3-SFT-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+RLHFlow-LLaMA3-SFT-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+RLHFlow-LLaMA3-SFT-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+RLHFlow-LLaMA3-SFT-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+featherless-quants.png filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,47 @@
+---
+base_model: RLHFlow/LLaMA3-SFT
+pipeline_tag: text-generation
+quantized_by: featherless-ai-quants
+---
+
+# RLHFlow/LLaMA3-SFT GGUF Quantizations 🚀
+
+![Featherless AI Quants](./featherless-quants.png)
+
+*Optimized GGUF quantization files for enhanced model performance*
+
+> Powered by [Featherless AI](https://featherless.ai) - run any model you'd like for a simple small fee.
+---
+
+## Available Quantizations 📊
+
+| Quantization Type | File | Size |
+|-------------------|------|------|
+| IQ4_XS | [RLHFlow-LLaMA3-SFT-IQ4_XS.gguf](https://huggingface.co/featherless-ai-quants/RLHFlow-LLaMA3-SFT-GGUF/blob/main/RLHFlow-LLaMA3-SFT-IQ4_XS.gguf) | 4276.62 MB |
+| Q2_K | [RLHFlow-LLaMA3-SFT-Q2_K.gguf](https://huggingface.co/featherless-ai-quants/RLHFlow-LLaMA3-SFT-GGUF/blob/main/RLHFlow-LLaMA3-SFT-Q2_K.gguf) | 3031.86 MB |
+| Q3_K_L | [RLHFlow-LLaMA3-SFT-Q3_K_L.gguf](https://huggingface.co/featherless-ai-quants/RLHFlow-LLaMA3-SFT-GGUF/blob/main/RLHFlow-LLaMA3-SFT-Q3_K_L.gguf) | 4121.74 MB |
+| Q3_K_M | [RLHFlow-LLaMA3-SFT-Q3_K_M.gguf](https://huggingface.co/featherless-ai-quants/RLHFlow-LLaMA3-SFT-GGUF/blob/main/RLHFlow-LLaMA3-SFT-Q3_K_M.gguf) | 3832.74 MB |
+| Q3_K_S | [RLHFlow-LLaMA3-SFT-Q3_K_S.gguf](https://huggingface.co/featherless-ai-quants/RLHFlow-LLaMA3-SFT-GGUF/blob/main/RLHFlow-LLaMA3-SFT-Q3_K_S.gguf) | 3494.74 MB |
+| Q4_K_M | [RLHFlow-LLaMA3-SFT-Q4_K_M.gguf](https://huggingface.co/featherless-ai-quants/RLHFlow-LLaMA3-SFT-GGUF/blob/main/RLHFlow-LLaMA3-SFT-Q4_K_M.gguf) | 4692.78 MB |
+| Q4_K_S | [RLHFlow-LLaMA3-SFT-Q4_K_S.gguf](https://huggingface.co/featherless-ai-quants/RLHFlow-LLaMA3-SFT-GGUF/blob/main/RLHFlow-LLaMA3-SFT-Q4_K_S.gguf) | 4475.28 MB |
+| Q5_K_M | [RLHFlow-LLaMA3-SFT-Q5_K_M.gguf](https://huggingface.co/featherless-ai-quants/RLHFlow-LLaMA3-SFT-GGUF/blob/main/RLHFlow-LLaMA3-SFT-Q5_K_M.gguf) | 5467.40 MB |
+| Q5_K_S | [RLHFlow-LLaMA3-SFT-Q5_K_S.gguf](https://huggingface.co/featherless-ai-quants/RLHFlow-LLaMA3-SFT-GGUF/blob/main/RLHFlow-LLaMA3-SFT-Q5_K_S.gguf) | 5339.90 MB |
+| Q6_K | [RLHFlow-LLaMA3-SFT-Q6_K.gguf](https://huggingface.co/featherless-ai-quants/RLHFlow-LLaMA3-SFT-GGUF/blob/main/RLHFlow-LLaMA3-SFT-Q6_K.gguf) | 6290.44 MB |
+| Q8_0 | [RLHFlow-LLaMA3-SFT-Q8_0.gguf](https://huggingface.co/featherless-ai-quants/RLHFlow-LLaMA3-SFT-GGUF/blob/main/RLHFlow-LLaMA3-SFT-Q8_0.gguf) | 8145.11 MB |
+
+
+---
+
+## ⚡ Powered by [Featherless AI](https://featherless.ai)
+
+### Key Features
+
+- 🔥 **Instant Hosting** - Deploy any Llama model on HuggingFace instantly
+- 🛠️ **Zero Infrastructure** - No server setup or maintenance required
+- 📚 **Vast Compatibility** - Support for 2400+ models and counting
+- 💎 **Affordable Pricing** - Starting at just $10/month
+
+---
+
+**Links:**  
+[Get Started](https://featherless.ai) | [Documentation](https://featherless.ai/docs) | [Models](https://featherless.ai/models)

RLHFlow-LLaMA3-SFT-IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:093e0de42d8c8051755ea13c24184f978bf5199f85df09704302adc68feac1a2
+size 4484362656

RLHFlow-LLaMA3-SFT-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e4048fc50e3a930ee8fcb6e9b90875f2750b74215850045b790b61308980367a
+size 3179131296

RLHFlow-LLaMA3-SFT-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd0408adbed14ede15405bd7407c63af8101ca5ee2178cb7149906956d88aa4a
+size 4321956256

RLHFlow-LLaMA3-SFT-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2cd9cbf7a96057b330120d2aabe30ac5da0c83692a947183245644f9047d7440
+size 4018917792

RLHFlow-LLaMA3-SFT-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f94e3691ee4710e73c5b927c23b52c4ed0407c300ff80e379b26fc7a6212953e
+size 3664499104

RLHFlow-LLaMA3-SFT-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:159cc8fa0f14c2d7e5a2e8a5cdc1de0024d87f70f88b5b08885f427020603a77
+size 4920734112

RLHFlow-LLaMA3-SFT-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1501737813fca9615427abcda88183e666f573db7c3f73064860ac7bf13dd88
+size 4692668832

RLHFlow-LLaMA3-SFT-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e0710af9694d92dbc65ef0bec9f9a180186d91d50524fde59a6829163124c5ff
+size 5732987296

RLHFlow-LLaMA3-SFT-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a8feddc237159ef44c569fa16a4b7cde9286a7364874ef7045e5ecd46e3e728f
+size 5599293856

RLHFlow-LLaMA3-SFT-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:648506cbaf9ab22a68281d06e52c4db984f9b068bf85af49df79d6357fa6f29c
+size 6596006304

RLHFlow-LLaMA3-SFT-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a74c6c81861323d8171210e4a834a7fcd1e0f3e9ad889340e4ff01c9693640c4
+size 8540770720