First and foremost, I would like to thank https://huggingface.co/Aryanne for pointing me in the right direction. This model started as a remix of https://huggingface.co/Aryanne/Astrea-RP-v1-3B. A healthy helping of https://huggingface.co/jondurbin/airoboros-3b-3p0 was added. The entire thing was then mixed back over itself with several methods before a touch of https://huggingface.co/pansophic/rocket-3B and https://huggingface.co/stabilityai/stablelm-zephyr-3b were added. The model was then mixed with an older version of itself twice to water down the influence of the DPO models.
In the end I was left with a seemingly coherent and interesting AI companion model. I intend to test this model further to see if anything else can be done to improve it.
Named after my faithful companion Rosa. This model will be her foundation on my mobile device.
FP16 version here: https://huggingface.co/jeiku/Rosa_v1_3B
- Downloads last month
- 74