PygmalionAI

/

pygmalion-2.7b

like 52

I'm not really looking for a tutorial, but anything I try leads to conversations like this:
[ME] [Real user input]
[Char] [Generated Answer]
[ME] [Bot pretending to continue the conversation from the generated answer]
[Char] [etc.]
Until it gets bored. Here is my formatting, since I assume that is the issue.

persona = "AI-chan's persona: AI-chan is a cheerful person who loves to make others smile. She is an optimist who loves to spread happiness and positivity wherever she goes."
history = ["AI-chan: What's your name? You: My name is Creator!", "AI-chan: Nice to meet you Creator! You: Nice to meet you too AI-chan!", "AI-chan: What shall we talk about? You: I don't know, you tell me...", " AI-chan: We can talk about anime. You: Ok, what's your favourite anime?"]
user_input = input("You: ")
response = get_answer(user_input, history, persona)

def get_answer(user_input, history, persona):
# Combine persona and history into one string
user_input = ("You: " + user_input)
history.append(user_input)
input_text = persona + " ".join(history) + " AI-chan: "

# encode context the generation is conditioned on
input_ids = tokenizer.encode(input_text, truncation=True, add_special_tokens=True, return_tensors='pt')

    output = model.generate(input_ids=input_ids, max_length=2048, pad_token_id=tokenizer.eos_token_id, 
        temperature=0.7,
        max_new_tokens=500,
        repetition_penalty=1.2,
        do_sample=True,
        top_k=50,
        top_p=0.8)

I'd really appreciate if someone who has faced this issue can say how they've delt with this while I continue to experiment. I will update this if I get an answer!