gghfez/Sorcerer_creative-writing-control-vectors

gghfez/Sorcerer_creative-writing-control-vectors

Creative Writing control-vectors for rAIfle/SorcererLM-8x22b-bf16

This is an excellent model, but I found it somewhat diffcult to steer via prompting.

These control vector solved it for me.

Usage example

llama-server --model SorcererLM-8x22b-iMat-IQ4_XS-00001-of-00002.gguf [other CLI arguments] \
    --control-vector  SorcererLM-8x22b-optimism_vs_nihilism__debias.gguf \
    --control-vector  <add as many as you want like this>.gguf

Train on 1xH100NVL using jukofyork's control-vectors

Based off Version v3.0 of creative-writing-control-vectors-v3.0.

See here for more info about control-vectors creative-writing-control-vectors-v3.0