---
base_model:
- Lambent/threebird-scribe-alpha0.3-7B
- Lambent/bigbird-scribe-7B
- Lambent/aetherbird-scribe-7B
- Lambent/songbird-scribe-7B
- Lambent/codebird-scribe-7B
library_name: transformers
tags:
- mergekit
- merge

---
# fourbirdstock

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details

| Tasks  |Version|Filter|n-shot|     Metric      |   | Value  |   |Stderr|
|--------|------:|------|-----:|-----------------|---|-------:|---|-----:|
|eq_bench|    2.1|none  |     0|eqbench          |↑  | 78.7955|±  |1.4668|
|        |       |none  |     0|percent_parseable|↑  |100.0000|±  |0.0000|

### Merge Method

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Lambent/threebird-scribe-alpha0.3-7B](https://huggingface.co/Lambent/threebird-scribe-alpha0.3-7B) as a base.

### Models Merged

The following models were included in the merge:
* [Lambent/bigbird-scribe-7B](https://huggingface.co/Lambent/bigbird-scribe-7B)
* [Lambent/aetherbird-scribe-7B](https://huggingface.co/Lambent/aetherbird-scribe-7B)
* [Lambent/songbird-scribe-7B](https://huggingface.co/Lambent/songbird-scribe-7B)
* [Lambent/codebird-scribe-7B](https://huggingface.co/Lambent/codebird-scribe-7B)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: Lambent/codebird-scribe-7B
  - model: Lambent/songbird-scribe-7B
  - model: Lambent/aetherbird-scribe-7B
  - model: Lambent/bigbird-scribe-7B
base_model: Lambent/threebird-scribe-alpha0.3-7B
merge_method: model_stock
parameters:
  filter_wise: false
tokenizer_source: union
dtype: float16


```