File size: 3,410 Bytes
820b6a0 2666ea6 820b6a0 af5c225 12a1158 59f3ca5 a7a9791 6c101cc 0bee82e 59f3ca5 7f1d6ba 59f3ca5 16f741b 07b082a 12a1158 07b082a 6f0c649 12a1158 bf1aed9 dc872f7 455ab4d 12a1158 30cdf7b 83fba86 30cdf7b a30dfc1 30cdf7b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
---
license: llama3
library_name: transformers
tags:
- not-for-all-audiences
---
<div align="left">
<img src="https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.V-Blackroot/resolve/main/MARK V BR.png" width="850"/>
</div>
### JAMETSSS
[GGUF](https://huggingface.co/backyardai/Jamet-8B-L3-MK.V-Blackroot-GGUF) made available by [Backyard AI](https://huggingface.co/backyardai)
[ANOTHER GGUF](https://huggingface.co/mradermacher/Jamet-8B-L3-MK.V-Blackroot-GGUF) made available by [mradermacher](https://huggingface.co/mradermacher)
Different base model, different methods (without model stock merge, because it's not good...at least for me, it gives repeating sentences or words at 0 temperature, that also happened with the Halu Blackroot). This model maybe more similar to the Anjir model.
This model has been on a long journey; I have like...9 variations of it. I tested all of them at Q4_K_M and decided to release this one, this is variation number 7.
And thanks for all the feedback from the previous model, it helps a lot. (I couldn't fix the issue with German because I don't know how to fix it since I can't speak German, heck, even my English is bad.)
**More Details:**
* This model is based on [this model](https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.II-LV), which is based on the UltimateAnjir model. It shares the same creative, cheerful, and positive tendencies. Then I merged it with Llama 3 Instruct.
* Next is DPO! to reduce the cheerfulness, emojis, and positivity. (This is based on the [Jamet MK.II Feedback](https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.II) regarding positivity.) I trained a QLora with about 1,000 prompts from Alpaca to generate a dataset, selecting the ones with emojis, removing the emojis using regex and moving those without emojis to the chosen, and the responses with emojis to the rejected.(With unsloth)
* Then, I applied the [Abomination Lora from Blackroot](https://huggingface.co/Blackroot/Llama-3-8B-Abomination-LORA).
* Next, I applied the [Anjir Adapter](https://huggingface.co/Hastagaras/ANJIR-ADAPTER-64) (64 Rank version with reduced Alpha) to improve formatting while retaining the previous Lora influences. (This is based on the Anjir Feedback, which suggests that Anjir has better formatting than the Halu Blackroot.)
* And then merged the model with the Anjrit model. (I won't release the Anjrit model as it struggles with longer contexts. I'm only interested in its no refusals storytelling abilities, but you can find a brief overview of the model on my [Anjir model](https://huggingface.co/Hastagaras/Anjir-8B-L3) page.)
And that's it. Thanks again for all the feedback!
**Notes:**
* I'm not responsible for anything.
* This is an RP and Storytelling model.
* You can write your feedback at the discussion, so i can improve my models.
* Like all of my previous models, higher temperatures will be incoherent, so use around 0.85-1.05.(I've been trying to fix this since Halu Blackroot but haven't had much luck, I think merging the base with Llama 3 Instruct helped a lot.)
<div align="left">
<img src="https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.V-Blackroot/resolve/main/chrome_UcaBMEjkH3.png" width="850"/>
</div>
<div align="left">
<img src="https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.V-Blackroot/resolve/main/chrome_BH9VUDnqZy.png" width="850"/>
</div>
^Sometimes it still gives a response with emojis (4Bit). |