RichardErkhov/eldogbbhed_-_Peagle-9b-4bits

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Peagle-9b - bnb 4bits

• Model creator: https://huggingface.co/eldogbbhed/
• Original model: https://huggingface.co/eldogbbhed/Peagle-9b/

Original model description:

license: cc-by-nc-4.0 tags: - merge - mergekit - vortexmergekit - mlabonne/NeuralBeagle14-7B - eldogbbhed/NeuralPearlBeagle

Peagle-9b

Hey there! 👋 Welcome to the Peagle-14b! This is a merge of multiple models brought together using the awesome VortexMerge kit.

Let's see what we've got in this merge:

• mlabonne/NeuralBeagle14-7B 🚀
• eldogbbhed/NeuralPearlBeagle 🚀

🧩 Configuration

slices:
  - sources:
      - model: mlabonne/NeuralBeagle14-7B
        layer_range: [0, 20]
  - sources:
      - model: eldogbbhed/NeuralPearlBeagle
        layer_range: [12, 32]
merge_method: passthrough