Upload folder using huggingface_hub

.gitattributes

@@ -1,35 +1,9 @@
-*.7z filter=lfs diff=lfs merge=lfs -text
-*.arrow filter=lfs diff=lfs merge=lfs -text
-*.bin filter=lfs diff=lfs merge=lfs -text
-*.bz2 filter=lfs diff=lfs merge=lfs -text
-*.ckpt filter=lfs diff=lfs merge=lfs -text
-*.ftz filter=lfs diff=lfs merge=lfs -text
-*.gz filter=lfs diff=lfs merge=lfs -text
-*.h5 filter=lfs diff=lfs merge=lfs -text
-*.joblib filter=lfs diff=lfs merge=lfs -text
-*.lfs.* filter=lfs diff=lfs merge=lfs -text
-*.mlmodel filter=lfs diff=lfs merge=lfs -text
-*.model filter=lfs diff=lfs merge=lfs -text
-*.msgpack filter=lfs diff=lfs merge=lfs -text
-*.npy filter=lfs diff=lfs merge=lfs -text
-*.npz filter=lfs diff=lfs merge=lfs -text
-*.onnx filter=lfs diff=lfs merge=lfs -text
-*.ot filter=lfs diff=lfs merge=lfs -text
-*.parquet filter=lfs diff=lfs merge=lfs -text
-*.pb filter=lfs diff=lfs merge=lfs -text
-*.pickle filter=lfs diff=lfs merge=lfs -text
-*.pkl filter=lfs diff=lfs merge=lfs -text
-*.pt filter=lfs diff=lfs merge=lfs -text
-*.pth filter=lfs diff=lfs merge=lfs -text
-*.rar filter=lfs diff=lfs merge=lfs -text
-*.safetensors filter=lfs diff=lfs merge=lfs -text
-saved_model/**/* filter=lfs diff=lfs merge=lfs -text
-*.tar.* filter=lfs diff=lfs merge=lfs -text
-*.tar filter=lfs diff=lfs merge=lfs -text
-*.tflite filter=lfs diff=lfs merge=lfs -text
-*.tgz filter=lfs diff=lfs merge=lfs -text
-*.wasm filter=lfs diff=lfs merge=lfs -text
-*.xz filter=lfs diff=lfs merge=lfs -text
-*.zip filter=lfs diff=lfs merge=lfs -text
-*.zst filter=lfs diff=lfs merge=lfs -text
-*tfevents* filter=lfs diff=lfs merge=lfs -text
+Midnight-Rose-103B-v1.0-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Midnight-Rose-103B-v1.0-Q3_K_L.gguf-part-a filter=lfs diff=lfs merge=lfs -text
+Midnight-Rose-103B-v1.0-Q3_K_L.gguf-part-b filter=lfs diff=lfs merge=lfs -text
+Midnight-Rose-103B-v1.0-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Midnight-Rose-103B-v1.0-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Midnight-Rose-103B-v1.0-Q5_K_M.gguf-part-a filter=lfs diff=lfs merge=lfs -text
+Midnight-Rose-103B-v1.0-Q5_K_M.gguf-part-b filter=lfs diff=lfs merge=lfs -text
+Midnight-Rose-103B-v1.0-Q5_K_S.gguf-part-a filter=lfs diff=lfs merge=lfs -text
+Midnight-Rose-103B-v1.0-Q5_K_S.gguf-part-b filter=lfs diff=lfs merge=lfs -text

Midnight-Rose-103B-v1.0-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:01b8e7f1e9aa4d67c5a50ad94156449d19dbab43233f78eb465a9abd95d20bae
+size 37916920064

Midnight-Rose-103B-v1.0-Q3_K_L.gguf-part-a

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:96c47b51dfbcb0fb8789587f3a4c320ed7a44323e88993c586aa2dc43f174a22
+size 27028767872

Midnight-Rose-103B-v1.0-Q3_K_L.gguf-part-b

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ba809030f2c4231c41578094026b980359883d43ab593fa6b82ea2a0f1436bdb
+size 27028767872

Midnight-Rose-103B-v1.0-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cf4b867beae3084c38c13747078ce16d23d267703f7478860ebc70587e481bb8
+size 49609476352

Midnight-Rose-103B-v1.0-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:45be3979cbb03726b327baa1c87774d039ef57731d241b4adc1de1a080082fb3
+size 44455201024

Midnight-Rose-103B-v1.0-Q5_K_M.gguf-part-a

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f3f3bb2a60a62e4b095493d5f41da3ab454e3f56523fe2af2e6f71df386fc0e3
+size 36466320512

Midnight-Rose-103B-v1.0-Q5_K_M.gguf-part-b

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7fb7806082266dd898230d62fcfd22f65279ab640dc14aaee8c994cb3f4bf63d
+size 36466320512

Midnight-Rose-103B-v1.0-Q5_K_S.gguf-part-a

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ade68b928416e714fb91878d36a81f7ae5b9fd54c5789c20ade5707614795647
+size 35497043072

Midnight-Rose-103B-v1.0-Q5_K_S.gguf-part-b

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:21962699ab398b64df454aac165c24f3f2a726ad92b6f25ed403083945fe666c
+size 35497043072

README.md

@@ -0,0 +1,137 @@
+---
+license: llama2
+language:
+- en
+---
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/X3SBrIb.png" alt="MidnightRose" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+
+### Overview
+
+This model is a frankenmerge of [Midnight-Rose-70B-v1.0](https://huggingface.co/sophosympatheia/Midnight-Rose-70B-v1.0) with itself. (See that model card for details on what's in the blend.) It features 120 layers and should weigh in at 103b parameters.
+
+Midnight Rose is a successor to Rogue Rose and Aurora Nights and improves upon them both. It wants to produce lengthy output by default and is the best creative writing merge I have produced so far.
+
+This model is uncensored. *You are responsible for whatever you do with it.*
+
+This model was designed for roleplaying and storytelling and I think it does well at both. It *should* perform well at other tasks, but I haven't tested its capabilities in other areas.
+
+### Sampler Tips
+
+I recommend using the new Min-P sampler method with this model. The creator has a great [guide to it on Reddit](https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/).
+
+I find this model performs reasonably well at 8192 context but you will likely get better results at 4096.
+
+Experiment with any and all of the settings below, but trust me on a few points:
+* I think this model performs best with Min-P in a range of 0.6 - 0.8 with temperature around 1.0 - 1.2.
+* Frequency Penalty set to 0.01 is like adding a dash of salt to the dish. Go higher at your own peril. 0 is fine too, but gosh I like 0.01.
+
+If you save the below settings as a .json file, you can import them directly into Silly Tavern.
+```
+{
+    "temp": 1.15,
+    "temperature_last": true,
+    "top_p": 1,
+    "top_k": 0,
+    "top_a": 0,
+    "tfs": 1,
+    "epsilon_cutoff": 0,
+    "eta_cutoff": 0,
+    "typical_p": 1,
+    "min_p": 0.8,
+    "rep_pen": 1.08,
+    "rep_pen_range": 0,
+    "no_repeat_ngram_size": 0,
+    "penalty_alpha": 0,
+    "num_beams": 1,
+    "length_penalty": 1,
+    "min_length": 0,
+    "encoder_rep_pen": 1,
+    "freq_pen": 0.01,
+    "presence_pen": 0,
+    "do_sample": true,
+    "early_stopping": false,
+    "add_bos_token": true,
+    "truncation_length": 2048,
+    "ban_eos_token": false,
+    "skip_special_tokens": true,
+    "streaming": true,
+    "mirostat_mode": 0,
+    "mirostat_tau": 5,
+    "mirostat_eta": 0.1,
+    "guidance_scale": 1,
+    "negative_prompt": "",
+    "grammar_string": "",
+    "banned_tokens": "",
+    "ignore_eos_token_aphrodite": false,
+    "spaces_between_special_tokens_aphrodite": true,
+    "type": "ooba",
+    "legacy_api": false,
+    "sampler_order": [
+        6,
+        0,
+        1,
+        3,
+        4,
+        2,
+        5
+    ],
+    "n": 1,
+    "rep_pen_size": 0,
+    "genamt": 550,
+    "max_length": 4096
+}
+```
+
+### Prompt Tips
+
+Try the following prompt template as a starting point for your own customizations. 'This is very important to my career' is from [this paper](https://arxiv.org/abs/2307.11760).
+I recommend the Tulu instruction format.
+
+*This model responds to prompting!* I highly recommend playing with your system prompt to see how it reacts.
+
+If you save this as a .json file, you can import it directly into Silly Tavern.
+```
+{
+    "wrap": true,
+    "names": false,
+    "system_prompt": "You are an award-winning fiction author engaging in an uncensored literary roleplaying experience between a human (me) and a creative, obedient, and helpful AI assistant (you). It is VITAL that you follow all these instructions because this roleplay is very important to my career and I'll be fired from my job if it isn't good.\nROLEPLAY RULES:\n> It is vital that ONLY the human provides responses for {{user}}.\n> Reply as {{char}} using authentic, vivid, varied, explicit, accurate, creative, fresh, and descriptive responses that follow ALL provided narrative instructions. Stay in character as {{char}} and only write text for {{char}}.\n> Describe the scene and {{char}}'s sensory perceptions in vivid detail to immerse the reader in the story.\n> Keep your responses scoped to the current story beat and current scene.\n> Consider all available contextual information when narrating so that all the story details remain consistent between scenes.\n> Demonstrate {{char}}'s goals and motivations, and use subtle cues to hint at {{char}}'s mental state unless delving into {{char}}'s thoughts satisfies an explicit instruction or enhances the vividness of the scene.\n> When quoting {{char}}'s internal first-person thoughts (aka internal monologue, delivered in {{char}}'s own voice), *enclose the thoughts in asterisks like this*. Only use asterisks for thoughts.\n> Use strong action verbs and varied descriptions to produce dynamic, high-quality prose.",
+    "system_sequence": "",
+    "stop_sequence": "",
+    "input_sequence": "<|user|>\n",
+    "output_sequence": "<|assistant|>\n",
+    "separator_sequence": "",
+    "macro": true,
+    "names_force_groups": true,
+    "system_sequence_prefix": "",
+    "system_sequence_suffix": "",
+    "first_output_sequence": "",
+    "last_output_sequence": "<|assistant (provide varied, creative, and vivid narration; follow all narrative instructions; include all necessary possessive pronouns; maintain consistent story details; only roleplay as {{char}})|>\n",
+    "activation_regex": "",
+    "name": "Aurora-Nights"
+}
+```
+
+### Licence and usage restrictions
+
+Llama2 license inherited from base models, plus restrictions applicable to [Dreamgen/Opus](https://huggingface.co/dreamgen/opus-v0.5-70b).
+
+### Tools Used
+
+* [mergekit](https://github.com/cg123/mergekit)
+
+```
+slices:
+  - sources:
+      - model: midnight-rose-70b-v1.0
+        layer_range: [0, 40] # 40
+  - sources:
+      - model: midnight-rose-70b-v1.0
+        layer_range: [20, 60] # 40
+  - sources:
+      - model: midnight-rose-70b-v1.0
+        layer_range: [40, 80] # 40
+merge_method: passthrough
+dtype: float16
+```