BitStack
/

BitStack-Llama-3.1-70B

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

BitStack-Llama-3.1-70B / README.md

Singhoo's picture

Update README.md

f2440b8 verified 5 months ago

|

history blame contribute delete

258 Bytes

metadata

library_name: transformers

This repository contains the BitStack-Llama-3.1-70B model as presented in BitStack: Fine-Grained Size Control for Compressed Large Language Models in Variable Memory Environments.