RichardErkhov
/

bn22_-_tinyllama_frankenmerge-4bits

4-bit precision

Model card Files Files and versions Community

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Quantization made by Richard Erkhov.

Request more models

tinyllama_frankenmerge - bnb 4bits

Model creator: https://huggingface.co/bn22/
Original model: https://huggingface.co/bn22/tinyllama_frankenmerge/

Original model description:

license: apache-2.0 tags: - merge - mergekit

tinyllama_frankenmerge

This model is a merge of the following models made with mergekit:

🧩 Configuration

slices:
  - sources:
    - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T
      layer_range: [0, 16]
  - sources:
    - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
      layer_range: [6, 22]
merge_method: passthrough
dtype: float16

Downloads last month: 0

Safetensors

Model size

858M params

Tensor type

F32

·

FP16

·

U8

·

Inference API

Unable to determine this model's library. Check the docs .