meta-llama
/

Llama-3.1-405B-FP8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (14)

Access request FAQ

#13 opened 4 months ago by

inference api no longer working

#18 opened 3 months ago by

Config KV Heads should be 8 now?

#16 opened 3 months ago by

Updated eos_token to include multiple IDs

#14 opened 3 months ago by