Na0s
/

Llama-3.1-8b-Pruned-5-Layers

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-8b-Pruned-5-Layers

File size: 202 Bytes

1c50977

dtype: bfloat16
merge_method: passthrough
slices:
- sources:
  - layer_range: [0, 22]
    model: meta-llama/Meta-Llama-3.1-8B
- sources:
  - layer_range: [28, 32]
    model: meta-llama/Meta-Llama-3.1-8B