--- base_model: - mlabonne/NeuralDaredevil-8B-abliterated - ResplendentAI/BlueMoon_Llama3 - saishf/Long-SOVL-Experiment-8B-L3-262K - mlabonne/NeuralDaredevil-8B-abliterated - ResplendentAI/Smarts_Llama3 - mlabonne/NeuralDaredevil-8B-abliterated - ResplendentAI/Aura_Llama3 - mlabonne/NeuralDaredevil-8B-abliterated - ResplendentAI/Luna_Llama3 - mlabonne/NeuralDaredevil-8B-abliterated - ResplendentAI/RP_Format_QuoteAsterisk_Llama3 library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [saishf/Long-SOVL-Experiment-8B-L3-262K](https://huggingface.co/saishf/Long-SOVL-Experiment-8B-L3-262K) as a base. ### Models Merged The following models were included in the merge: * [mlabonne/NeuralDaredevil-8B-abliterated](https://huggingface.co/mlabonne/NeuralDaredevil-8B-abliterated) + [ResplendentAI/BlueMoon_Llama3](https://huggingface.co/ResplendentAI/BlueMoon_Llama3) * [mlabonne/NeuralDaredevil-8B-abliterated](https://huggingface.co/mlabonne/NeuralDaredevil-8B-abliterated) + [ResplendentAI/Smarts_Llama3](https://huggingface.co/ResplendentAI/Smarts_Llama3) * [mlabonne/NeuralDaredevil-8B-abliterated](https://huggingface.co/mlabonne/NeuralDaredevil-8B-abliterated) + [ResplendentAI/Aura_Llama3](https://huggingface.co/ResplendentAI/Aura_Llama3) * [mlabonne/NeuralDaredevil-8B-abliterated](https://huggingface.co/mlabonne/NeuralDaredevil-8B-abliterated) + [ResplendentAI/Luna_Llama3](https://huggingface.co/ResplendentAI/Luna_Llama3) * [mlabonne/NeuralDaredevil-8B-abliterated](https://huggingface.co/mlabonne/NeuralDaredevil-8B-abliterated) + [ResplendentAI/RP_Format_QuoteAsterisk_Llama3](https://huggingface.co/ResplendentAI/RP_Format_QuoteAsterisk_Llama3) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: mlabonne/NeuralDaredevil-8B-abliterated+ResplendentAI/Aura_Llama3 - model: mlabonne/NeuralDaredevil-8B-abliterated+ResplendentAI/Smarts_Llama3 - model: mlabonne/NeuralDaredevil-8B-abliterated+ResplendentAI/Luna_Llama3 - model: mlabonne/NeuralDaredevil-8B-abliterated+ResplendentAI/BlueMoon_Llama3 - model: mlabonne/NeuralDaredevil-8B-abliterated+ResplendentAI/RP_Format_QuoteAsterisk_Llama3 merge_method: model_stock base_model: saishf/Long-SOVL-Experiment-8B-L3-262K dtype: bfloat16 ```