Update README.md

Files changed (1) hide show

README.md CHANGED Viewed

@@ -1,3 +1,3 @@
-Model upload coming soon, source model from https://huggingface.co/Peeepy/Airoboros-13b-SuperHOT-8k.
 You will need a monkey-patch at inference to use the 8k context, please see patch file present, if you are using a different inference engine (like llama.cpp / exllama) you will need to add the monkey patch there.


1	+ Model upload in 4-bit GPTQ version, converted using GPTQ-for-LLaMa; Source model from https://huggingface.co/Peeepy/Airoboros-13b-SuperHOT-8k.
2
3	You will need a monkey-patch at inference to use the 8k context, please see patch file present, if you are using a different inference engine (like llama.cpp / exllama) you will need to add the monkey patch there.