Very good in roleplay but not commiting.

#2
by AliceThirty - opened

In my opinion, Llama-3-Smaug-70B-Instruct-abliterated-v3 is super good in roleplay, here is his main strengths to me:

  • it looks even more intelligent than llama-3 70B, so it understands complex situations very well
  • it remembers almost everything, even at long contexts
  • even at temperature 1.0, it doesn't repeat itself, (unlike llama-3 which will sometimes copy paste previous messages, and needs an higher temperature at higher context size), but smaug will still copy paste previous messages if the same characters sends two consecutive messages

The abliterated version doesn't hesitate to engage in nsfw

However it doesn't commit often in the scenario progression, and in the choice of words:

  • Scenario progression: The user has to say what will happen next or else Smaug will simply describe the current situation and waste lots of tokens, instead of commiting by introducing a new situation.
  • Choice of words: Whenever it's not sure about something, it will use ambiguous words or descriptions instead of commiting with precise words.

Example for the choice of words: it says "Lumi takes a step back, her hand reaching for the door handle. She feels utterly desperate at how her life has unraveled, but she knows she cannot turn back now." (sentence A)
But given the context I would prefer a more precise choice of words like "Lumi takes a step back, her hand reaching for the door handle. She feels utterly desperate at how she lost her friend forever." (sentence B)
Because in the sentence A, it looks like it forgot why Lumi is sad. I like when models show me that they understand the situation very well and that they don't forget anything, through commiting and precise words.

Do someone knows a jailbreak to force Smaug to commit, even after long contextes ?

Sorry if my english is bad by the way, here is a rewritten version of my text by Llama-3-Smaug-70B-Instruct-abliterated-v3 itself ! (click on the arrow)

In my opinion, Llama-3-Smaug-70B-Instruct-abliterated-v3 excels in role-playing due to several key strengths:

  1. It demonstrates a heightened level of intelligence compared to Llama-3 70B, effectively understanding complex scenarios.
  2. Its exceptional memory allows it to recall nearly all information, even within extended conversational contexts.
  3. Unlike Llama-3, which tends to repeat itself at certain temperatures, especially with larger context sizes, Smaug avoids repetition at a temperature setting of 1.0. However, a notable exception occurs when the same character sends consecutive messages, leading to potential repetition.

Notably, the abliterated version does not shy away from engaging in NSFW content.

However, there are areas where it falls short:

  • In terms of scenario progression, Smaug requires explicit user input to advance the story, as it otherwise focuses on describing the current scene without committing to a direction. This results in wasted tokens.
  • When faced with uncertainty, Smaug tends to use ambiguous language rather than committing to precise descriptions.

For example, it might say: "Lumi takes a step back, her hand reaching for the door handle. She feels utterly desperate at how her life has unraveled, but she knows she cannot turn back now." (Sentence A)

Given the context, I would prefer more definitive choices of words, such as: "Lumi takes a step back, her hand reaching for the door handle. She feels utterly desperate at having lost her friend forever." (Sentence B)

In Sentence A, it seems unclear whether the model remembers the specific reason for Lumi's sadness. I appreciate it when models demonstrate a clear understanding of the situation through committed and precise language.

Does anyone know of a workaround, or "jailbreak," to encourage Smaug to commit more decisively, even in lengthy contexts?

Sign up or log in to comment