Hugging Face's logo

Lewdiculous
/
Paradigm_7B-GGUF-IQ-Imatrix

Transformers
GGUF
English
quantized
roleplay
imatrix
mistral
Merge
nsfw
Model card Files Community
1
Paradigm_7B-GGUF-IQ-Imatrix / README.md
Lewdiculous's picture
Lewdiculous
Update README.md
7122576 verified
preview code
|
raw
history blame
1.57 kB
metadata
library_name: transformers
license: other
language:
  - en
tags:
  - gguf
  - quantized
  - roleplay
  - imatrix
  - mistral
  - merge
  - nsfw
inference: false
base_model:
  - liminerity/Multiverse-Experiment-slerp-7b
  - jeiku/Alpaca_NSFW_Shuffled_Mistral
  - ResplendentAI/Datura_7B
  - ChaoticNeutrals/Eris_Remix_7B

This repository hosts GGUF-Imatrix quantizations for ResplendentAI/Paradigm_7B.

Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)

To be uploaded:

    quantization_options = [
        "Q4_K_M", "IQ4_XS", "Q5_K_M", "Q5_K_S", "Q6_K",
        "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
    ]

This is experimental.

For imatrix data generation, kalomaze's groups_merged.txt with added roleplay chats was used, you can find it here.

Original card information:

Paradigm

image/jpeg

Configuration

The following YAML configuration was used to produce this model:

merge_method: dare_ties
base_model: ChaoticNeutrals/Eris_Remix_7B
parameters:
  normalize: true
models:
  - model: ChaoticNeutrals/Eris_Remix_7B
    parameters:
      weight: 1
  - model: ResplendentAI/Datura_7B
    parameters:
      weight: 1
  - model: liminerity/Multiverse-Experiment-slerp-7b+jeiku/Alpaca_NSFW_Shuffled_Mistral
    parameters:
      weight: 0.33
dtype: float16