Hugging Face's logo

Solshine
/
Brimful-290B-merged-replete

Text Generation
Transformers
Safetensors
qwen2
mergekit
Merge
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Brimful-290B-merged-replete / README.md
Solshine's picture
Solshine
Update README.md
51e5183 verified
preview code
|
raw
history blame contribute delete
42.2 kB
---
base_model:
- Qwen/Qwen2.5-72B-Instruct
- Replete-AI/Replete-LLM-V2.5-Qwen-7b
library_name: transformers
tags:
- mergekit
- merge
---
# merge
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the passthrough merge method.
This model recieved no post merge retraining (yet) and minimal testing. Please contribute any feedback or evaluations of any kind via the community tab.
### Models Merged
The following models were included in the merge:
* [Qwen/Qwen2.5-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-72B-Instruct)
* [Replete-AI/Replete-LLM-V2.5-Qwen-7b](https://huggingface.co/Replete-AI/Replete-LLM-V2.5-Qwen-7b)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
slices:
# Replete-AI Layer 0, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [0, 1]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [0, 1]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [0, 1]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [0, 1]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [0, 1]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [0, 1]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [0, 1]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [0, 1]
# Qwen 72B Layer 0, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [0, 1]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [0, 1]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [0, 1]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [0, 1]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [0, 1]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [0, 1]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [0, 1]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [0, 1]
# Replete-AI Layer 1, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [1, 2]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [1, 2]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [1, 2]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [1, 2]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [1, 2]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [1, 2]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [1, 2]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [1, 2]
# Qwen 72B Layer 1, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [1, 2]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [1, 2]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [1, 2]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [1, 2]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [1, 2]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [1, 2]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [1, 2]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [1, 2]
# Replete-AI Layer 2, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [2, 3]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [2, 3]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [2, 3]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [2, 3]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [2, 3]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [2, 3]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [2, 3]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [2, 3]
# Qwen 72B Layer 2, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [2, 3]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [2, 3]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [2, 3]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [2, 3]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [2, 3]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [2, 3]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [2, 3]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [2, 3]
# Replete-AI Layer 3, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [3, 4]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [3, 4]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [3, 4]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [3, 4]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [3, 4]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [3, 4]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [3, 4]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [3, 4]
# Qwen 72B Layer 3, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [3, 4]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [3, 4]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [3, 4]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [3, 4]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [3, 4]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [3, 4]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [3, 4]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [3, 4]
# Replete-AI Layer 4, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [4, 5]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [4, 5]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [4, 5]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [4, 5]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [4, 5]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [4, 5]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [4, 5]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [4, 5]
# Qwen 72B Layer 4, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [4, 5]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [4, 5]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [4, 5]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [4, 5]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [4, 5]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [4, 5]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [4, 5]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [4, 5]
# Replete-AI Layer 5, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [5, 6]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [5, 6]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [5, 6]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [5, 6]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [5, 6]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [5, 6]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [5, 6]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [5, 6]
# Qwen 72B Layer 5, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [5, 6]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [5, 6]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [5, 6]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [5, 6]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [5, 6]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [5, 6]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [5, 6]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [5, 6]
# Replete-AI Layer 6, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [6, 7]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [6, 7]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [6, 7]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [6, 7]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [6, 7]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [6, 7]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [6, 7]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [6, 7]
# Qwen 72B Layer 6, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [6, 7]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [6, 7]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [6, 7]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [6, 7]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [6, 7]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [6, 7]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [6, 7]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [6, 7]
# Replete-AI Layer 7, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [7, 8]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [7, 8]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [7, 8]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [7, 8]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [7, 8]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [7, 8]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [7, 8]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [7, 8]
# Qwen 72B Layer 7, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [7, 8]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [7, 8]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [7, 8]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [7, 8]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [7, 8]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [7, 8]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [7, 8]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [7, 8]
# Replete-AI Layer 8, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [8, 9]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [8, 9]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [8, 9]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [8, 9]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [8, 9]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [8, 9]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [8, 9]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [8, 9]
# Qwen 72B Layer 8, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [8, 9]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [8, 9]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [8, 9]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [8, 9]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [8, 9]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [8, 9]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [8, 9]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [8, 9]
# Replete-AI Layer 9, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [9, 10]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [9, 10]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [9, 10]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [9, 10]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [9, 10]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [9, 10]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [9, 10]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [9, 10]
# Qwen 72B Layer 9, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [9, 10]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [9, 10]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [9, 10]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [9, 10]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [9, 10]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [9, 10]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [9, 10]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [9, 10]
# Replete-AI Layer 10, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [10, 11]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [10, 11]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [10, 11]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [10, 11]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [10, 11]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [10, 11]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [10, 11]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [10, 11]
# Qwen 72B Layer 10, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [10, 11]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [10, 11]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [10, 11]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [10, 11]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [10, 11]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [10, 11]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [10, 11]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [10, 11]
# Replete-AI Layer 11, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [11, 12]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [11, 12]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [11, 12]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [11, 12]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [11, 12]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [11, 12]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [11, 12]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [11, 12]
# Qwen 72B Layer 11, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [11, 12]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [11, 12]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [11, 12]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [11, 12]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [11, 12]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [11, 12]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [11, 12]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [11, 12]
# Replete-AI Layer 12, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [12, 13]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [12, 13]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [12, 13]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [12, 13]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [12, 13]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [12, 13]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [12, 13]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [12, 13]
# Qwen 72B Layer 12, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [12, 13]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [12, 13]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [12, 13]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [12, 13]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [12, 13]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [12, 13]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [12, 13]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [12, 13]
# Replete-AI Layer 13, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [13, 14]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [13, 14]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [13, 14]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [13, 14]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [13, 14]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [13, 14]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [13, 14]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [13, 14]
# Qwen 72B Layer 13, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [13, 14]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [13, 14]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [13, 14]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [13, 14]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [13, 14]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [13, 14]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [13, 14]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [13, 14]
# Replete-AI Layer 14, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [14, 15]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [14, 15]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [14, 15]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [14, 15]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [14, 15]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [14, 15]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [14, 15]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [14, 15]
# Qwen 72B Layer 14, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [14, 15]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [14, 15]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [14, 15]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [14, 15]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [14, 15]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [14, 15]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [14, 15]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [14, 15]
# Replete-AI Layer 15, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [15, 16]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [15, 16]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [15, 16]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [15, 16]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [15, 16]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [15, 16]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [15, 16]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [15, 16]
# Qwen 72B Layer 15, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [15, 16]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [15, 16]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [15, 16]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [15, 16]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [15, 16]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [15, 16]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [15, 16]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [15, 16]
# Replete-AI Layer 16, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [16, 17]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [16, 17]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [16, 17]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [16, 17]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [16, 17]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [16, 17]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [16, 17]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [16, 17]
# Qwen 72B Layer 16, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [16, 17]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [16, 17]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [16, 17]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [16, 17]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [16, 17]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [16, 17]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [16, 17]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [16, 17]
# Replete-AI Layer 17, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [17, 18]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [17, 18]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [17, 18]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [17, 18]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [17, 18]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [17, 18]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [17, 18]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [17, 18]
# Qwen 72B Layer 17, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [17, 18]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [17, 18]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [17, 18]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [17, 18]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [17, 18]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [17, 18]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [17, 18]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [17, 18]
# Replete-AI Layer 18, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [18, 19]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [18, 19]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [18, 19]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [18, 19]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [18, 19]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [18, 19]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [18, 19]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [18, 19]
# Qwen 72B Layer 18, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [18, 19]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [18, 19]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [18, 19]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [18, 19]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [18, 19]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [18, 19]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [18, 19]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [18, 19]
# Replete-AI Layer 19, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [19, 20]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [19, 20]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [19, 20]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [19, 20]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [19, 20]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [19, 20]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [19, 20]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [19, 20]
# Qwen 72B Layer 19, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [19, 20]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [19, 20]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [19, 20]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [19, 20]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [19, 20]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [19, 20]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [19, 20]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [19, 20]
# Replete-AI Layer 20, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [20, 21]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [20, 21]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [20, 21]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [20, 21]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [20, 21]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [20, 21]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [20, 21]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [20, 21]
# Qwen 72B Layer 20, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [20, 21]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [20, 21]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [20, 21]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [20, 21]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [20, 21]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [20, 21]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [20, 21]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [20, 21]
# Replete-AI Layer 21, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [21, 22]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [21, 22]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [21, 22]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [21, 22]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [21, 22]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [21, 22]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [21, 22]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [21, 22]
# Qwen 72B Layer 21, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [21, 22]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [21, 22]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [21, 22]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [21, 22]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [21, 22]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [21, 22]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [21, 22]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [21, 22]
# Replete-AI Layer 22, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [22, 23]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [22, 23]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [22, 23]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [22, 23]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [22, 23]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [22, 23]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [22, 23]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [22, 23]
# Qwen 72B Layer 22, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [22, 23]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [22, 23]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [22, 23]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [22, 23]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [22, 23]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [22, 23]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [22, 23]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [22, 23]
# Replete-AI Layer 23, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [23, 24]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [23, 24]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [23, 24]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [23, 24]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [23, 24]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [23, 24]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [23, 24]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [23, 24]
# Qwen 72B Layer 23, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [23, 24]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [23, 24]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [23, 24]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [23, 24]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [23, 24]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [23, 24]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [23, 24]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [23, 24]
# Replete-AI Layer 24, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [24, 25]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [24, 25]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [24, 25]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [24, 25]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [24, 25]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [24, 25]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [24, 25]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [24, 25]
# Qwen 72B Layer 24, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [24, 25]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [24, 25]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [24, 25]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [24, 25]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [24, 25]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [24, 25]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [24, 25]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [24, 25]
# Replete-AI Layer 25, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [25, 26]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [25, 26]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [25, 26]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [25, 26]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [25, 26]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [25, 26]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [25, 26]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [25, 26]
# Qwen 72B Layer 25, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [25, 26]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [25, 26]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [25, 26]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [25, 26]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [25, 26]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [25, 26]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [25, 26]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [25, 26]
# Replete-AI Layer 26, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [26, 27]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [26, 27]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [26, 27]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [26, 27]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [26, 27]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [26, 27]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [26, 27]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [26, 27]
# Qwen 72B Layer 26, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [26, 27]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [26, 27]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [26, 27]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [26, 27]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [26, 27]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [26, 27]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [26, 27]
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [26, 27]
# Replete-AI Layer 27, repeated 8 times
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [27, 28]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [27, 28]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [27, 28]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [27, 28]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [27, 28]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [27, 28]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [27, 28]
- sources:
- model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
layer_range: [27, 28]
# Qwen 72B Layer 27, repeated 8 times
- sources:
- model: Qwen/Qwen2.5-72B-Instruct
layer_range: [27, 80]
merge_method: passthrough
dtype: float16
```