vsevolodl
/

Yi-1.5-34B-Chat-GGUF

Inference Endpoints

Model card Files Files and versions Community

No model card

New: Create and edit this model card directly on the website!

Contribute a Model Card

Downloads last month: 48

GGUF

Model size

34.4B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API

Unable to determine this model's library. Check the docs .

Collection including vsevolodl/Yi-1.5-34B-Chat-GGUF

Yi-1.5 (2024/05)

Quantized versions of Yi-1.5 models (May 2024) • 2 items • Updated May 15