Hugging Face model: baseten/llama3-70b_int8_tp2_i4096_o1024_bs32_fmha-tllm_0.9.0.dev2024040200
Author: baseten
Created: 2024-05-29 05:53:35
Last modified: 2024-05-29 05:56:15
Library: transformers
Likes: 0 | Downloads: 4
Tags: transformers, endpoints_compatible, region:us
Card metadata: