Yi-1.5-6B-Chat-GGUF / README.md
larenspear's picture
Create README.md
198d6e1 verified
metadata
base_model: 01-ai/Yi-1.5-6B
language:
  - en
library_name: transformers
license: apache-2.0
quantized_by: larenspear

About

GGUF Quantizations of https://huggingface.co/01-ai/Yi-1.5-6B

Provided Quantizations

Link Type
GGUF Q2_K
GGUF Q3_K_S
GGUF Q3_K_M
GGUF Q3_K_L
GGUF Q4_0
GGUF Q4_K_S
GGUF Q4_K_M
GGUF Q5_0
GGUF Q5_K_S
GGUF Q5_K_M
GGUF Q6_K
GGUF Q8_0

In a circular citation, I borrowed the format of this file from https://huggingface.co/mradermacher/copy_of_wildjailbreak_13-GGUF.