RichardErkhov
/

bn22_-_tinyllama_frankenmerge-8bits

8-bit precision

Model card Files Files and versions Community

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Quantization made by Richard Erkhov.

Request more models

tinyllama_frankenmerge - bnb 8bits

Model creator: https://huggingface.co/bn22/
Original model: https://huggingface.co/bn22/tinyllama_frankenmerge/

Original model description:

license: apache-2.0 tags: - merge - mergekit

tinyllama_frankenmerge

This model is a merge of the following models made with mergekit:

🧩 Configuration

slices:
  - sources:
    - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T
      layer_range: [0, 16]
  - sources:
    - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
      layer_range: [6, 22]
merge_method: passthrough
dtype: float16

Downloads last month: 2

Safetensors

Model size

1.54B params

Tensor type

F32

·

FP16

·

I8

·

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.