fakezeta
/

Mirai-Nova-Llama3-LocalAI-8B-v0.1-ov-int8

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Mirai-Nova-Llama3-LocalAI-8B-v0.1-ov-int8 / model.yaml

fakezeta's picture

Upload 9 files

a583781 verified about 1 month ago

raw history blame contribute delete

No virus

197 Bytes

	name: mirai-nova
	backend: transformers
	parameters:
	model: fakezeta/Mirai-Nova-Llama3-LocalAI-8B-v0.1-ov-int8
	context_size: 8192
	type: OVModelForCausalLM
	template:
	use_tokenizer_template: true