Hugging Face's logo

Lewdiculous
/
Paradigm_Shift_7B-GGUF-IQ-Imatrix

GGUF
English
Not-For-All-Audiences
Model card Files Community
1
Paradigm_Shift_7B-GGUF-IQ-Imatrix / README.md
Lewdiculous's picture
Lewdiculous
Create README.md
4a6b72a verified
preview code
|
raw
history blame
1.34 kB
metadata
license: cc-by-sa-4.0
datasets:
  - unalignment/toxic-dpo-v0.2
  - athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED
  - grimulkan/theory-of-mind
  - FriezaForce/unranked_theory_of_mind_roleplay
language:
  - en
tags:
  - not-for-all-audiences
inference: false

This repository hosts GGUF-Imatrix quantizations for ResplendentAI/Paradigm_Shift_7B.

Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)

Quants:

    quantization_options = [
        "Q4_K_M", "IQ4_XS", "Q5_K_M", "Q5_K_S", "Q6_K",
        "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
    ]

If you want anything that's not here or another model, feel free to request.

This is experimental.

For imatrix data generation, kalomaze's groups_merged.txt with added roleplay chats was used, you can find it here.

Original card information:

Paradigm Shift

image/jpeg

A more compliant finetune of Paradigm. I have briefly tested this and it should more readily answer NSFW and difficult queries with fewer refusals. This model will be well suited to RP and question answering.