--- base_model: - T145/ZEUS-8B-V17 - Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 library_name: transformers tags: - mergekit - merge --- # ZEUS-8B-V17-abliterated This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the passthrough merge method. ### Models Merged The following models were included in the merge: * [T145/ZEUS-8B-V17](https://huggingface.co/T145/ZEUS-8B-V17) * [Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2](https://huggingface.co/Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2) ### Configuration The following YAML configuration was used to produce this model: ```yaml slices: - sources: - model: T145/ZEUS-8B-V17 layer_range: [0, 18] - sources: # Reasoning: The script used to abliterate V2 & V13 identified layer 19 as the target with the most refusal. # Substituting the whole layer with that from the uncensored model should effectively abliterate V17 and future similar merges. - model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 layer_range: [19, 19] - sources: - model: T145/ZEUS-8B-V17 layer_range: [20, 32] merge_method: passthrough tokenizer_source: T145/ZEUS-8B-V17 dtype: bfloat16 ```