Hugging Face's logo

bn22
/
tinyllama_frankenmerge

Text Generation
Transformers
Safetensors
llama
Merge
mergekit
text-generation-inference
Inference Endpoints
Model card Files Community
1
Edit model card

tinyllama_frankenmerge

This model is a merge of the following models made with mergekit:

🧩 Configuration 

slices:
  - sources:
    - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T
      layer_range: [0, 16]
  - sources:
    - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
      layer_range: [6, 22]
merge_method: passthrough
dtype: float16
Downloads last month
1,005
Safetensors
Model size
1.54B params
Tensor type
FP16
·
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including bn22/tinyllama_frankenmerge