Spaces:

Justinrune
/

LLaMA-Factory

Running

LLaMA-Factory / examples /inference /llama3_vllm.yaml

Upload folder using huggingface_hub

2852136 verified 5 months ago

118 Bytes

	model_name_or_path: meta-llama/Meta-Llama-3-8B-Instruct
	template: llama3
	infer_backend: vllm
	vllm_enforce_eager: true