--- base_model: - Sao10K/L3-70B-Euryale-v2.1 - tdrussell/Llama-3-70B-Instruct-Storywriter library_name: transformers tags: - mergekit - merge --- # Untitled Model (1) This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the SLERP merge method. ### Models Merged The following models were included in the merge: * [Sao10K/L3-70B-Euryale-v2.1](https://huggingface.co/Sao10K/L3-70B-Euryale-v2.1) * [tdrussell/Llama-3-70B-Instruct-Storywriter](https://huggingface.co/tdrussell/Llama-3-70B-Instruct-Storywriter) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: tdrussell/Llama-3-70B-Instruct-Storywriter - model: Sao10K/L3-70B-Euryale-v2.1 merge_method: slerp base_model: tdrussell/Llama-3-70B-Instruct-Storywriter dtype: bfloat16 parameters: t: 0.5 # V shaped curve: Hermes for input & output, WizardMath in the middle layers ```