PrunaAI
/

TheBloke-Llama-2-7B-fp16-bnb-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

TheBloke-Llama-2-7B-fp16-bnb-4bit-smashed

1 contributor

History: 6 commits

sharpenb's picture

3c85fcf7a988ec74f816fb0aea64774540fea2b04e742dec8e26e9380ad50be4

e1a6539 verified 8 months ago

.gitattributes

1.52 kB

initial commit 8 months ago
README.md

5.37 kB

3c85fcf7a988ec74f816fb0aea64774540fea2b04e742dec8e26e9380ad50be4 8 months ago
config.json

1.1 kB

3c85fcf7a988ec74f816fb0aea64774540fea2b04e742dec8e26e9380ad50be4 8 months ago
generation_config.json

132 Bytes

Upload folder using huggingface_hub (#1) 8 months ago
model.safetensors

4.17 GB
LFS

dc3906836f62f798d6f6f466b3549b9bf240812bec71b4381e37b61a62b8740d 8 months ago
plots.png

438 kB

3c85fcf7a988ec74f816fb0aea64774540fea2b04e742dec8e26e9380ad50be4 8 months ago
smash_config.json

909 Bytes

3c85fcf7a988ec74f816fb0aea64774540fea2b04e742dec8e26e9380ad50be4 8 months ago