Hugging Face's logo

MaziyarPanahi
/
TheTop-7B-DPO-S2-v0.2

Text Generation
Transformers
Safetensors
mistral
Merge
text
text-generation-inference
Inference Endpoints
Model card Files Community
TheTop-7B-DPO-S2-v0.2 / README.md
MaziyarPanahi's picture
MaziyarPanahi
Update README.md
b481cfa verified
preview code
|
raw
history blame contribute delete
No virus
533 Bytes
metadata
license: apache-2.0
library_name: transformers
pipeline_tag: text-generation
tags:
  - merge
  - text

MaziyarPanahi/TheTop-7B-DPO-S2-v0.2

Merge of top 7B models with SLERP method.

mergekit is a toolkit for merging pre-trained language models. mergekit uses an out-of-core approach to perform unreasonably elaborate merges in resource-constrained situations. Merges can be run entirely on CPU or accelerated with as little as 8 GB of VRAM. Many merging algorithms are supported, with more coming as they catch my attention.