casperhansen
/

llama-3-70b-instruct-awq

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Update generation_config.json

#2

by hmellor - opened Apr 19

base: refs/heads/main

←

from: refs/pr/2

Discussion Files changed

Update generation_config.json7cd06cb1

hmellor

Apr 19

Add missing EOS token as is now present in the un-quantised config https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct/blob/main/generation_config.json

casperhansen changed pull request status to merged Apr 19

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment