Felladrin
/

gguf-sharded-smashed-WizardLM-2-7B

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Sharded GGUF version of PrunaAI/WizardLM-2-7B-GGUF-smashed.

Downloads last month: 2

GGUF

Model size

7.24B params

Architecture

llama

2-bit

Inference API

Unable to determine this model's library. Check the docs .

Model tree for Felladrin/gguf-sharded-smashed-WizardLM-2-7B

Base model

PrunaAI/WizardLM-2-7B-GGUF-smashed

Quantized

(1)

this model