Edit model card

Quantizations of https://huggingface.co/icefog72/IceLatteRP-7b

From original readme

IceLatteRP-7b

image/png

This is a merge of pre-trained language models created using mergekit.

Merge Details

I'm preaty satisfied with this result.

Downloads last month
124
GGUF
Model size
7.24B params
Architecture
llama

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API (serverless) has been turned off for this model.