Hugging Face's logo

Natkituwu
/
Poppy_Porpoise-0.72-L3-8B-6.5bpw-exl2

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
conversational
text-generation-inference
Inference Endpoints
exl2
Model card Files Community
Poppy_Porpoise-0.72-L3-8B-6.5bpw-exl2 / README.md
Natkituwu's picture
Natkituwu
Update README.md
7c9dc60 verified
preview code
|
raw history blame contribute delete
No virus
1.61 kB
metadata
base_model:
  - Nitral-AI/PP_0.71b
  - Nitral-AI/PP_0.71a
library_name: transformers
tags:
  - mergekit
  - merge
license: other

6.5bpw exl2 quant of : https://huggingface.co/Nitral-AI/Poppy_Porpoise-0.72-L3-8B

Should be perfect for 12k context for 8GB VRAM Cards (if using linux)

"Poppy Porpoise" is a cutting-edge AI roleplay assistant based on the Llama 3 8B model, specializing in crafting unforgettable narrative experiences. With its advanced language capabilities, Poppy expertly immerses users in an interactive and engaging adventure, tailoring each adventure to their individual preferences.

image/png

Quants Available From Lewdiculus: https://huggingface.co/Lewdiculous/Poppy_Porpoise-0.72-L3-8B-GGUF-IQ-Imatrix

Recomended ST Presets:(Updated for 0.72) Porpoise Presets

If you want to use vision functionality:

  • You must use the latest versions of Koboldcpp.

To use the multimodal capabilities of this model and use vision you need to load the specified mmproj file, this can be found inside this model repo. Llava MMProj

  • You can load the mmproj by using the corresponding section in the interface:

image/png