Hugging Face model: baseten/llama3-70b-instruct_fp8_tp4_i4096_o1024_bs40_fmha-tllm_0.11.0.dev2024052100
Author: baseten
Created: 2024-06-04 15:49:45
Last modified: 2024-06-04 15:52:31
Library: transformers
Likes: 0 | Downloads: 4
Tags: transformers, endpoints_compatible, region:us
Card metadata: