Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+miqu-1-120b.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,93 @@
+---
+base_model:
+- 152334H/miqu-1-70b-sf
+language:
+- en
+- de
+- fr
+- es
+- it
+library_name: transformers
+tags:
+- mergekit
+- merge
+---
+# miqu-1-120b
+
+![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6303ca537373aacccd85d8a7/LxO9j7OykuabKLYQHIodG.jpeg)
+
+This is a 120b frankenmerge of [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) created by interleaving layers of [miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) with itself using [mergekit](https://github.com/cg123/mergekit).
+
+Inspired by [Venus-120b-v1.2](https://huggingface.co/nsfwthrowitaway69/Venus-120b-v1.2), [MegaDolphin-120b](https://huggingface.co/cognitivecomputations/MegaDolphin-120b), and [goliath-120b](https://huggingface.co/alpindale/goliath-120b).
+
+Thanks for the support, [CopilotKit](https://github.com/CopilotKit/CopilotKit) - the open-source platform for building in-app AI Copilots into any product, with any LLM model. Check out their GitHub.
+
+## Prompt template: Mistral
+
+```
+<s>[INST] {prompt} [/INST]
+```
+
+See also: [🐺🐦‍⬛ LLM Prompt Format Comparison/Test: Mixtral 8x7B Instruct with **17** different instruct templates : LocalLLaMA](https://www.reddit.com/r/LocalLLaMA/comments/18ljvxb/llm_prompt_format_comparisontest_mixtral_8x7b/)
+
+## Model Details
+
+* Max Context: 32764 tokens (kept the weird number from the original/base model)
+* Layers: 140
+
+## Merge Details
+
+### Merge Method
+
+This model was merged using the passthrough merge method.
+
+### Models Merged
+
+The following models were included in the merge:
+* [152334H/miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+dtype: float16
+merge_method: passthrough
+slices:
+- sources:
+  - layer_range: [0, 20]
+    model: 152334H/miqu-1-70b-sf
+- sources:
+  - layer_range: [10, 30]
+    model: 152334H/miqu-1-70b-sf
+- sources:
+  - layer_range: [20, 40]
+    model: 152334H/miqu-1-70b-sf
+- sources:
+  - layer_range: [30, 50]
+    model: 152334H/miqu-1-70b-sf
+- sources:
+  - layer_range: [40, 60]
+    model: 152334H/miqu-1-70b-sf
+- sources:
+  - layer_range: [50, 70]
+    model: 152334H/miqu-1-70b-sf
+- sources:
+  - layer_range: [60, 80]
+    model: 152334H/miqu-1-70b-sf
+```
+
+## Credits & Special Thanks
+
+* original (unreleased) model: [mistralai (Mistral AI_)](https://huggingface.co/mistralai)
+* leaked model: [miqudev/miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b)
+* f16 model: [152334H/miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf)
+* mergekit: [arcee-ai/mergekit: Tools for merging pretrained large language models.](https://github.com/arcee-ai/mergekit)
+* mergekit_config.yml: [nsfwthrowitaway69/Venus-120b-v1.2](https://huggingface.co/nsfwthrowitaway69/Venus-120b-v1.2)
+- gguf quantization: [ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++](https://github.com/ggerganov/llama.cpp)
+
+### Support
+
+* [My Ko-fi page](https://ko-fi.com/wolframravenwolf) if you'd like to tip me to say thanks or request specific models to be tested or merged with priority. Also consider supporting your favorite model creators, quantizers, or frontend/backend devs if you can afford to do so. They deserve it!
+
+#### DISCLAIMER: THIS IS [BASED ON A LEAKED ASSET](https://huggingface.co/miqudev/miqu-1-70b/discussions/10) AND HAS NO LICENSE ASSOCIATED WITH IT. USE AT YOUR OWN RISK.

miqu-1-120b.IQ3_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:084229d79fe5d836738c3666c5734f937b0bb699cec34f1bc7cf75435944e395
+size 46880781760