|
--- |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
tags: |
|
- miqu |
|
- 70b model |
|
- cat |
|
- miqu cat |
|
--- |
|
## Welcome to Miqu Cat: A 70B Miqu Lora Fine-Tune |
|
|
|
Introducing **Miqu Cat**, an advanced model fine-tuned by Dr. Kal'tsit then quanted for the the ExllamaV2 project, bringing the model down to an impressive 4.8 bits per weight (bpw). This fine-tuning allows those with limited computational resources to explore its capabilities without compromise. |
|
|
|
### Competitive Edge - *meow!* |
|
|
|
Miqu Cat stands out in the arena of Miqu fine-tunes, consistently performing admirably in tests and comparisons. It’s crafted to be less restrictive and more robust than its predecessors and variants, making it a versatile tool in AI-driven applications. |
|
**48GB VRAM to load the model for 8192 Context Length** *["2x3090", "1xA6000", "1xA100 80GB", "etc."]* |
|
|
|
### How to Use Miqu Cat: The Nitty-Gritty |
|
|
|
Miqu Cat operates on the **CHATML** prompt format, designed for straightforward and effective interaction. Whether you're integrating it into existing systems or using it for new projects, its flexible prompt structure facilitates ease of use. |
|
|
|
### Training Specs |
|
|
|
- **Dataset**: 1.5 GB |
|
- **Compute**: Dual setup of 8xA100 nodes |
|
|
|
### Meet the Author |
|
|
|
**Dr. Kal'tsit** has been at the forefront of this fine-tuning process, ensuring that Miqu Cat gives the user a unique feel. |
|
|
