TheFloat16
/

Llama3-70b-Instruct-TRTLLM

Text Generation

Model card Files Files and versions Community

Llama3-70b-Instruct-TRTLLM

1 contributor

History: 10 commits

matichon's picture

Create config.json

135bb9c verified 5 months ago

quantized-llama-3-70b-pp1-tp1-awq-w4a16-kvfp16-gs64
Upload folder using huggingface_hub 5 months ago
quantized-llama-3-70b-pp1-tp1-awq-w4a16-kvfp8-gs64
Upload folder using huggingface_hub 5 months ago
quantized-llama-3-70b-pp1-tp1-awq-w4a16-kvint8-gs64
Upload folder using huggingface_hub 5 months ago
quantized-llama-3-70b-pp1-tp2-awq-w4a16-kvfp16-gs64
Upload folder using huggingface_hub 5 months ago
quantized-llama-3-70b-pp1-tp2-awq-w4a16-kvfp8-gs64
Upload folder using huggingface_hub 5 months ago
quantized-llama-3-70b-pp1-tp2-awq-w4a16-kvint8-gs64
Upload folder using huggingface_hub 5 months ago
quantized-llama-3-70b-pp1-tp4-awq-w4a16-kvfp16-gs64
Upload folder using huggingface_hub 5 months ago
quantized-llama-3-70b-pp1-tp4-awq-w4a16-kvfp8-gs64
Upload folder using huggingface_hub 5 months ago
quantized-llama-3-70b-pp1-tp4-awq-w4a16-kvint8-gs64
Upload folder using huggingface_hub 5 months ago
quantized-llama-3-70b-pp1-tp8-awq-w4a16-kvfp16-gs64
Upload folder using huggingface_hub 5 months ago
quantized-llama-3-70b-pp1-tp8-awq-w4a16-kvfp8-gs64
Upload folder using huggingface_hub 5 months ago
quantized-llama-3-70b-pp1-tp8-awq-w4a16-kvint8-gs64
Upload folder using huggingface_hub 5 months ago
.gitattributes

1.52 kB

initial commit 5 months ago
.gitignore

58 Bytes

Update .gitignore 5 months ago
README.md

34 kB

Update README.md 5 months ago
config.json

698 Bytes

Create config.json 5 months ago