Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
pankajroark
/
llama-fp16-engine
like
0
Model card
Files
Files and versions
Community
a3806a1
llama-fp16-engine
/
7b-sq-int8kv-tp8
1 contributor
History:
1 commit
pankajroark
tp8 checkpoint
a3806a1
12 months ago
config.json
1.32 kB
tp8 checkpoint
12 months ago
llama_float16_tp8_rank0.engine
1.11 GB
LFS
tp8 checkpoint
12 months ago
llama_float16_tp8_rank1.engine
1.11 GB
LFS
tp8 checkpoint
12 months ago
llama_float16_tp8_rank2.engine
1.11 GB
LFS
tp8 checkpoint
12 months ago
llama_float16_tp8_rank3.engine
1.11 GB
LFS
tp8 checkpoint
12 months ago
llama_float16_tp8_rank4.engine
1.11 GB
LFS
tp8 checkpoint
12 months ago
llama_float16_tp8_rank5.engine
1.11 GB
LFS
tp8 checkpoint
12 months ago
llama_float16_tp8_rank6.engine
1.11 GB
LFS
tp8 checkpoint
12 months ago
llama_float16_tp8_rank7.engine
1.11 GB
LFS
tp8 checkpoint
12 months ago
model.cache
109 kB
tp8 checkpoint
12 months ago