Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
DeepInfra
/
Llama-2-70b-chat-hf-trt-fp8
like
0
Follow
Deep Infra Inc.
5
License:
llama2
Model card
Files
Files and versions
Community
dd20dba
Llama-2-70b-chat-hf-trt-fp8
/
tensorrt_llm
/
1
2 contributors
History:
5 commits
yessenzhar
update models for newer trt 0.6.1 version
dd20dba
about 1 year ago
config.json
Safe
1.57 kB
update models for newer trt 0.6.1 version
about 1 year ago
llama_float16_tp4_rank0.engine
Safe
17.8 GB
LFS
add weights compiled by 0.6.1 trtllm
about 1 year ago
llama_float16_tp4_rank1.engine
Safe
17.8 GB
LFS
add weights compiled by 0.6.1 trtllm
about 1 year ago
llama_float16_tp4_rank2.engine
Safe
17.8 GB
LFS
add weights compiled by 0.6.1 trtllm
about 1 year ago
llama_float16_tp4_rank3.engine
Safe
17.8 GB
LFS
add weights compiled by 0.6.1 trtllm
about 1 year ago
model.cache
Safe
13.8 MB
LFS
add weights compiled by 0.6.1 trtllm
about 1 year ago
