Hugging Face model: ildodeltaRule/Yi-6B-200K-AWQ-VLLM
Author: ildodeltaRule
Created: 2024-07-22 07:54:44
Last modified: 2024-07-23 15:18:55
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 6
Tags: transformers, safetensors, Yi, text-generation, custom_code, base_model:01-ai/Yi-6B-200K, base_model:quantized:01-ai/Yi-6B-200K, license:other, 4-bit, awq, region:us
Base model relation: quantized
Base models: id: 01-ai/Yi-6B-200K
Card metadata:
base_model: 01-ai/Yi-6B-200K
inference: no
license: other
license_link: LICENSE
license_name: yi-license
model_creator: 01-ai
model_name: Yi 6B 200K
model_type: yi
prompt_template: {prompt}

quantized_by: TheBloke