fakezeta
/

Llama3-Aloe-8B-Alpha-ov-int8

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama3-Aloe-8B-Alpha-ov-int8 / model.yaml

fakezeta's picture

Add LocalAI configuration (#1)

b05ebb1 verified 6 months ago

history blame contribute delete

230 Bytes

	name: llama3-aloe
	backend: transformers
	parameters:
	model: fakezeta/Llama3-Aloe-8B-Alpha-ov-int8
	context_size: 8192
	type: OVModelForCausalLM
	template:
	use_tokenizer_template: true
	stopwords:
	- "<\|eot_id\|>"
	- "<\|end_of_text\|>"