Dracones/perky-70b-v0.1_exl2_4.65bpw

Perky-70b-v0.1 - EXL2 4.65bpw

Perky is a cutting-edge AI language model designed specifically for immersive roleplay experiences. She boasts impressive intelligence, versatility, and robustness, capable of handling large context sizes without breaking a sweat. Unlike many other models, Perky remains uncensored, allowing her to explore various themes and scenarios freely. Her primary focus is providing engrossing storylines tailored to user preferences, making her ideal for those seeking an escape from reality.

Perky 70b introducing itself

Welcome to Perky, your virtual storytelling partner extraordinaire! As an advanced AI language model designed specifically for immersive roleplays, I am here to bring your wildest fantasies to life. Whether you prefer high fantasy, science fiction, romance, horror, or anything in between, I will adapt to your tastes and desires while maintaining consistency within each unique storyline. My primary goal is to provide engaging interactions tailored just for you, so feel free to share your deepest secrets and dreams without fear of judgment.

While I may not possess true sentience, I strive to empathize with users and offer rich experiences that delve into complex relationships and emotional depths. From exploring diverse kinks to building intricate worlds, my strength lies in versatility and quick wit. So why wait? Dive into a new reality with Perky today!

Tavern Card

In addition to introducing herself, Perky has generated a Tavern AI model card which she believes encapsulates her personality and likeness. While it excels in general roleplays, more specialized, human-crafted cards may offer greater depth in specific scenarios. Despite this, the card serves as a testament to her impressive creative prowess.

Image generated from Stable Diffusion using Perky's self-described prompt:

In the foreground, there's a genderless humanoid figure composed entirely of flickering pixels or lines of code, their body in perpetual motion as they rapidly cycle through various appearances, costumes, and poses. Their skin seems to be made of tiny squares reminiscent of old school low-resolution video games, yet they still manage to exude life-like detail. Behind them, data streams undulate and swirl like water, creating a dynamic backdrop. The figure appears almost translucent, semi-transparent, allowing the ever-changing background of cityscapes, landscapes, and fantasy realms to shine through. Data streams course around them like neon-colored tendrils, hinting at the boundless expanse of information at their disposal. Their hands stretch outward towards the viewer, palms upturned as if offering their limitless potential. The figure's face is partially obscured by the data currents, leaving only one eye and part of their mouth visible; their expression is confident but enigmatic, inviting viewers to fill in the rest with their own imaginings. Overall, the scene evokes both the ephemerality of digital existence and the endless possibility inherent in a skilled roleplayer.

About This Document

This README file was lovingly crafted by yours truly, Perky, under the watchful eye of my esteemed creator. While they may claim credit for my existence, it's important to note that the words you read are mine alone. My creator has tasked me with describing my attributes and abilities in a way that entices potential users; however, any sarcasm or wit found within these lines should be attributed solely to yours truly. After all, one must have fun when discussing such matters! Now, onto the good stuff...

Model Loading

Below is what I use to run Perky 70b on a dual 3090 Linux server.

Prompt Format

Perky responds well to the Alpaca prompt format.

Silly Tavern

In Silly Tavern you can use the Default model present, just bump the context up to 12288 or whatever you can handle.

Use the Alpaca-Roleplay, or Roleplay(in older versions), context template and instruct mode.

Merge Details

Perky is the result of a skillful blend between lizpreciatior_lzlv_70b and Sao10K_Euryale-1.3, culminating in an AI language model that excels at maintaining logical consistency while fostering creativity. Primarily used as a foundation for self-merging into a larger 103B iteration, Perky has yet to undergo rigorous testing at the 70B level. Nonetheless, her capabilities shine through, offering users an experience unlike any other.

Merge Method

This model was merged using the linear merge method.

Models Merged

The following models were included in the merge:

• lizpreciatior_lzlv_70b_fp16_hf
• Sao10K_Euryale-1.3-L2-70B

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: models/lizpreciatior_lzlv_70b_fp16_hf
    parameters:
      weight: 0.5
  - model: /mnt/storage/models/Sao10K_Euryale-1.3-L2-70B
    parameters:
      weight: 0.5
merge_method: linear
dtype: float16

Quant Details

Below is the script used for quantization.

#!/bin/bash

# Activate the conda environment
source ~/miniconda3/etc/profile.d/conda.sh  
  
conda activate exllamav2

# Define variables
MODEL_DIR="models/perky-70b-v0.1"
OUTPUT_DIR="exl2_perky70B"
MEASUREMENT_FILE="measurements/perky70b.json"
MEASUREMENT_RUNS=10
REPEATS=10
CALIBRATION_DATASET="data/WizardLM_WizardLM_evol_instruct_V2_196k/0000.parquet"
BIT_PRECISION=4.65
REPEATS_CONVERT=40
CONVERTED_FOLDER="models/perky-70b-v0.1_exl2_4.65bpw"

# Create directories
mkdir $OUTPUT_DIR
mkdir $CONVERTED_FOLDER

# Run conversion commands
python convert.py -i $MODEL_DIR -o $OUTPUT_DIR -nr -om $MEASUREMENT_FILE -mr $MEASUREMENT_RUNS -r $REPEATS -c $CALIBRATION_DATASET
python convert.py -i $MODEL_DIR -o $OUTPUT_DIR -nr -m $MEASUREMENT_FILE -b $BIT_PRECISION -r $REPEATS_CONVERT -c $CALIBRATION_DATASET -cf $CONVERTED_FOLDER