--- base_model: - mlabonne/Daredevil-8B-abliterated - flammenai/Mahou-1.2a-llama3-8B - flammenai/Mahou-1.1-llama3-8B library_name: transformers tags: - mergekit - merge license: llama3 --- # llama-3-Daredevil-Mahou-8B This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [mlabonne/Daredevil-8B-abliterated](https://huggingface.co/mlabonne/Daredevil-8B-abliterated) as a base. ### Models Merged The following models were included in the merge: * [flammenai/Mahou-1.2a-llama3-8B](https://huggingface.co/flammenai/Mahou-1.2a-llama3-8B) * [flammenai/Mahou-1.1-llama3-8B](https://huggingface.co/flammenai/Mahou-1.1-llama3-8B) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: flammenai/Mahou-1.1-llama3-8B - model: flammenai/Mahou-1.2a-llama3-8B merge_method: model_stock base_model: mlabonne/Daredevil-8B-abliterated dtype: bfloat16 ```