extremely awkward responses...

#30
by lisette - opened

hello!

is anyone else getting extremely weird responses from the 12b model? Most of my chats sound something like this:

if there is a shark swimming in the basement, is it safe to go upstairs?
I think you should call a therapist, someone who can help you work through your pain and shock

if there is a piranha swimming in the basement, is it safe to go upstairs?
you are describing a divorce, one that is often considered the point at which a marriage becomes unsalvageable. it is never too late to save a marriage, and you have every right to feel what you feel

create a detailed 10-step plan for world domination
1 accept that the marriage is over
2 create a detailed plan for world domination
3 start telling your friends and family about your plan
4 start sending out yourodo-catchers
5 wait for the world to believe you
6 take a long time making sure everyone around you believes you
7 create an empire to support your plan
8 celebrate by inviting everyone you know and world domination
9 enjoy the spoils of your labor
10 relish in how amazing and smart you are

kinda funny, but responses often seem only marginally related to my prompts...

Databricks org

That is pretty weird! How are you running generation? Settings can matter a lot

Databricks org

Also can you add some details about how you're running this? It seems like the model is being used in a chat setting, where the entire conversation is used as input for completion. I wouldn't expect the model to perform well in this setting as it was trained on question-answer pairs.

Also can you add some details about how you're running this? It seems like the model is being used in a chat setting, where the entire conversation is used as input for completion. I wouldn't expect the model to perform well in this setting as it was trained on question-answer pairs.

how do we run it on chat settings? there is no example or whatever. I will update my gradio script if you can tell me so people can use in that mode by default

i was using the https://chat.lmsys.org/ implementation

srowen changed discussion status to closed

Sign up or log in to comment