Hugging Face model: baseten/llama3-70b-instruct_fp8_tp2_i7068_o1024_bs40_mnt_10000_mp_fmha_moae-tllm_0.11.0.dev2024061800
Author: baseten
Created: 2024-06-21 03:08:04
Last modified: 2024-06-21 03:10:35
Library: transformers
Likes: 0 | Downloads: 3
Tags: transformers, endpoints_compatible, region:us
Card metadata: