---
license: other
language:
- en
pipeline_tag: text-generation
inference: false
tags:
- transformers
- gguf
- imatrix
- Jellyfish-13B
---
Quantizations of https://huggingface.co/NECOUDBFM/Jellyfish-13B

### Experiment

Quants **ending in "_X"** are experimental quants. These quants are the same as normal quants, but their token embedding weights are set to Q8_0 except for Q6_K and Q8_0 which are set to F16. The change will make these experimental quants larger but ***in theory***, should result in improved performance.

List of experimental quants: 
* Q2_K_X
* Q4_K_M_X
* Q5_K_M_X
* Q6_K_X
* Q8_0_X

---

### Inference Clients/UIs
* [llama.cpp](https://github.com/ggerganov/llama.cpp)
* [JanAI](https://github.com/janhq/jan)
* [KoboldCPP](https://github.com/LostRuins/koboldcpp)
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui)
* [ollama](https://github.com/ollama/ollama)

---

# From original readme

## Model Details
Jellyfish-13B is a large language model equipped with 13 billion parameters. It's tailored specifically for data preprocessing tasks, including entity matching, data imputation, error detection, and schema matching.

## Prompt Template
```
### Instruction:

<prompt> (without the <>)

### Response:
```