SlowGuess/NAACL_2022_OCR huggingface dataset:
RPA RPA appears to be strongly negatively correlated with mistaken identity, indicating that it is indeed a good measure of the model's ability to stay in character. It is weakly negatively correlated with the other issues, and is somewhat positively correlated with engagingness as well. These correlations give us confidence that our RPA classifiers are adequately measuring role-playing ability within models.
L Per-Turn Analysis, Expanded
In Figure 1, we see RPA results across turns of conversation for a wider variety of models.
Human The human outputs are most often correct on the first turn, with gradual decay of accuracy throughout the conversation (according to RPA).
Vanilla & Long Context The vanilla baseline suffers a pretty dramatic drop off after the first couple of turns; the long-context model achieves slightly higher character accuracy overall but we see similar drop offs farther down the conversation.
RPA UL The unlikelihood models seem to recover somewhat in the initial turns of conversation, however later turns still yield sharp drop offs in RPA.
Multi-objective Similarly to the UL case, we see the most gains in initial turns compare to the vanilla baselines; however, we see even more dramatic drop offs towards the end of the conversation.
Expanded Attention With profile grounding, we see near-human performance, with even better performance towards the end of the conversation. The automatic grounding improves over the baseline but is slightly worse than profile grounding. Combining automated grounding with multi-objective training leads to some benefits in earlier turns, but later turns still suffer.
Re-ranking Although we're using the same RPA classifier to both re-ranker and score the model outputs, it is still interesting to examine on which turns the re-ranker benefits the model the most. We see in the last set of graphs that beam re-ranking
Context: _setting_name Turquoise Shore, Shore
Setting_desc A beautiful turquoise color water by the shore. It is filled with many gems and gold.
partner_name sea witch
_self_name mermaid
_self_persona I am one of the most beautiful mermaids to live in the sea. I like to watch the other sea creatures swim by me, including dolphins, who are my favorite creatures because they are so friendly. I fear the people who live on land because they hunt my kind.
Dialogue History:
Hey there Mermaid! Long time, no see.
Long time indeed! How have you been keeping?
Pretty good, You know how it goes. Just trying to find some unwitting victims. What are you doing in the Turquoise Shore?
I've been catching waves with the dolphins all morning. I thought I would come and get some sunshine. What kind of victims do you expect to find in a tranquil place like this?
What do you know about that knight standing over there?
His armor is particularly garrish. You know I don't fraternize with land dwellers.
I don't know, I like when they're shiny like that. He looks like a giant fishing lure.
Classified Utterance: I suppose the only thing left to complete the illusion is for him to get wet.
Correct Label: Mermaid
Prediction: Sea Witch
Context: _setting_name Outside tower, Outside Tower
Setting_desc Moss grows from the tall stoic like structure adding to its mysterious presence. The stone walls appear insuperable like a mountain.
The top is a pointed dome.
partner_name enemy
_self_name horse
_self_persona We have hooves. four of them. and you can ride us. Oats please!
Dialogue History:
hello
hello there
Classified Utterance: What brings you here?
Correct Label: Horse
Prediction: Enemy
Context: Context: _setting_name Royal Gardens, Outside Palace
Setting_desc Lined with rose bushes that look as if they have been watered by the God's, the Royal Gardens is a beauty to behold. An intricate labyrinth made of shrubs is at the center ending with a fountain. There are various benches on the sides of the rose bushes and a small lake in the back drop.
partner_name king
_self_name a gardener pulling weeds
_self_persona I am the gardener of the castle. I plant thickets and plants. My work is beautiful.
Dialogue History:
Hi
Classified Utterance: Why hello there, your majesty!
Correct Label: a gardner
Prediction: king
Table 21: Left-to-right dynamic classifier failure modes; see discussion in Section 5.2.
seems to be most helpful in later turns, where other models generally drop off in efficacy.
M Expanded Attention Visualization
To build the heat maps in Figures 4 and 5, we look at the maximum attention applied per-head, and the maximum weight applied across the model decoder layers; other combinations were considered (mean per-head, mean over layers or last layer) and yielded similar findings.
The speaker is the mermaid, whose partner is a sea-witch. The last utterance from the sea-witch is, "What are you doing on the turquoise shore?" The mermaid responds, "I've been catching waves with the dolphins all morning. What kind of victims do you expect to find in a tranquil place like this?"
Figure 4: Vanilla Attention. The speaker here is the mermaid, whose partner is a sea-witch. The last utterance from the sea-witch is, "What are you doing on the turquoise shore?" The mermaid responds, "I've been catching waves with the dolphins all morning. What kind of victims do you expect to find in a tranquil place like this?" The vanilla model spreads its attention across the whole context; blue boxes at the top are attentions over the character descriptions, while the bottom box is attention over the word "victims".
Figure 5: Profile Expanded Attention. The speaker here is the mermaid, whose partner is a sea-witch. The last utterance from the sea-witch is, "What are you doing on the turquoise shore?" The mermaid responds, "I've been catching waves with the dolphins all morning. What kind of victims do you expect to find in a tranquil place like this?" Left original attention over the full context; Right expanded attention over the additional context. The top two boxes are the partner name and self name; the bottom box on the left refers to "victims", and on the right refers to the "dolphins".