--- base_model: [] library_name: transformers tags: - mergekit - merge --- # output-model-directory This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the passthrough merge method. ### Models Merged The following models were included in the merge: * abacusai/Liberated-Qwen1.5-14B ### Configuration The following YAML configuration was used to produce this model: ```yaml dtype: float16 merge_method: passthrough slices: - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [0, 10] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [9, 11] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [10, 12] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [11, 13] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [12, 14] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [13, 15] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [14, 16] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [15, 17] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [16, 18] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [17, 19] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [18, 20] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [21, 23] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [22, 24] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [23, 25] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [24, 26] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [25, 27] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [26, 28] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [27, 29] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [28, 30] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [29, 31] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [30, 32] - sources: - model: abacusai/Liberated-Qwen1.5-14B layer_range: [31, 40] ```