--- base_model: - jeiku/ToxicNoRobotsRosaHermesBoros_3B - jeiku/Everything_v3_StableLM - jeiku/ToxicNoRobotsRosaHermesBoros_3B - jeiku/Theory_of_Mind_StableLM - jeiku/ToxicNoRobotsRosaHermesBoros_3B tags: - mergekit - merge --- # newkid2 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [jeiku/ToxicNoRobotsRosaHermesBoros_3B](https://huggingface.co/jeiku/ToxicNoRobotsRosaHermesBoros_3B) as a base. ### Models Merged The following models were included in the merge: * [jeiku/ToxicNoRobotsRosaHermesBoros_3B](https://huggingface.co/jeiku/ToxicNoRobotsRosaHermesBoros_3B) + [jeiku/Everything_v3_StableLM](https://huggingface.co/jeiku/Everything_v3_StableLM) * [jeiku/ToxicNoRobotsRosaHermesBoros_3B](https://huggingface.co/jeiku/ToxicNoRobotsRosaHermesBoros_3B) + [jeiku/Theory_of_Mind_StableLM](https://huggingface.co/jeiku/Theory_of_Mind_StableLM) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: jeiku/ToxicNoRobotsRosaHermesBoros_3B+jeiku/Everything_v3_StableLM parameters: weight: 0.25 density: 0.25 - model: jeiku/ToxicNoRobotsRosaHermesBoros_3B+jeiku/Theory_of_Mind_StableLM parameters: weight: 0.25 density: 0.25 merge_method: dare_ties base_model: jeiku/ToxicNoRobotsRosaHermesBoros_3B parameters: dtype: bfloat16 ```