fakezeta
/

Yi-1.5-6B-Chat-ov-int8

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Yi-1.5-6B-Chat-ov-int8

File size: 173 Bytes

30f8207

name: Yi-6B
backend: transformers
parameters:
  model: fakezeta/Yi-1.5-6B-Chat-ov-int8
context_size: 8192
type: OVModelForCausalLM
template:
  use_tokenizer_template: true