Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

joostinyi-baseten
/

llama_7b_sq0.8_intkv_custom_a_r

Inference Endpoints

Model card Files Files and versions Community

llama_7b_sq0.8_intkv_custom_a_r

1 contributor

History: 2 commits

joostinyi-baseten's picture

joostinyi-baseten

Upload folder using huggingface_hub

6f3bf02 about 1 year ago

.gitattributes

1.59 kB

Upload folder using huggingface_hub about 1 year ago
config.json

1.32 kB

Upload folder using huggingface_hub about 1 year ago
llama_float16_tp1_rank0.engine

7.01 GB
LFS

Upload folder using huggingface_hub about 1 year ago
model.cache

88 kB

Upload folder using huggingface_hub about 1 year ago