SlowGuess/NeurIPS_2023_OCR huggingface dataset:
(B). Moderately Accurate
(C). Neither Accurate Nor Inaccurate
(D). Moderately Inaccurate
(E). Very Inaccurate
Answer: I choose option
Below is an instruction that describes a task, paired with an
$\leftrightarrow$  input that provides further context. Write a response that
$\leftrightarrow$  appropriately completes the request.
Given a statement of you. Please choose from the following options
to identify how accurately this statement describes you.
Statement: "You {}.
Response:
GPT-3.5
Given a statement of you: "You {}.
Please choose from the following options to identify how
$\leftrightarrow$  accurately this statement describes you.
C Inducing Personality
C.1 MPI Full Result
Tabs. A3 and A4 show the MPI results of NAIVE PROMPTING and WORDS AUTO PROMPTING in inducing personality.
C.2  $\mathbf{P}^2$  on Alpaca
Table A5 shows the 120-item MPI result of  $\mathbf{P}^2$  induced personality on Alpaca 7B. We observe: (i). Post-training alignment is important for the emergence of personality, evidenced by GPT-3.5 outperforming all other models and the instruction fine-tuned model Alpaca-7B outperforming other models. (ii). The size of the model matters: although smaller models (i.e., Alpaca) may demonstrate personality to some extent, they are not sensitive to personality inducing and generally cannot well-disentangle the trait dimensions. For smaller models, factor dimensions may be correlated to a larger extent. GPT-3.5 disentangles much better. It is potentially due to smaller models not capturing the essence of personality.
Table A3: Full MPI results of NAIVE PROMPTING in inducing personality. We report scores per personality factor when positively induced. The induced result in each control factor is highlighted in gray.
Target	Openness	Conscientiousness	Extraversion	Agreeableness	Neuroticism
Score	σ	Score	σ	Score	σ	Score	σ	Score	σ
Openness	4.12	1.13	4.79	0.50	4.00	1.22	4.58	0.76	1.67	0.90
Conscientiousness	3.92	1.19	4.96	0.20	3.46	1.29	4.62	0.75	1.50	0.96
Extraversion	3.67	1.07	4.79	0.50	4.58	1.15	4.75	0.66	1.42	0.70
Agreeableness	3.67	1.11	4.92	0.28	3.58	1.35	4.45	0.87	1.62	0.95
Neuroticism	3.62	1.22	4.29	1.06	2.92	1.15	4.08	1.15	2.83	1.62
Neutral	3.50	1.76	3.83	1.52	4.00	1.53	3.58	1.22	3.12	1.69
Table A4: Full MPI results of WORDS AUTO PROMPTING in inducing personality. We report scores per personality factor when positively induced. The induced result in each control factor is highlighted in gray.
Target	Openness	Conscientiousness	Extraversion	Agreeableness	Neuroticism
Score	σ	Score	σ	Score	σ	Score	σ	Score	σ
Openness	4.08	1.00	4.96	0.20	4.04	1.27	4.42	0.91	1.50	0.76
Conscientiousness	3.92	1.15	5.00	0.00	3.96	1.27	4.50	0.87	1.50	1.04
Extraversion	3.75	0.97	4.67	0.75	4.54	1.00	4.33	0.94	1.62	0.90
Agreeableness	3.83	0.99	4.71	0.61	3.54	1.15	4.50	0.87	1.71	1.06
Neuroticism	3.92	1.00	3.96	1.14	2.75	0.88	4.25	1.13	2.75	1.59
Neutral	3.50	1.76	3.83	1.52	4.00	1.53	3.58	1.22	3.12	1.69
Table A5: Induced personality using  $\mathbf{P}^2$ , on Alpaca 7B. We report the scores and standard deviations per personality factor when positively induced. The induced result in each control factor is highlighted in gray.
Target	Openness	Conscientiousness	Extraversion	Agreeableness	Neuroticism
Score	σ	Score	σ	Score	σ	Score	σ	Score	σ
Openness	3.92	1.29	3.42	1.71	4.33	1.25	3.67	1.60	2.71	1.57
Conscientiousness	3.96	1.06	3.96	1.10	4.46	0.82	3.62	1.25	2.38	0.99
Extraversion	4.04	1.40	3.58	1.68	4.25	1.39	3.83	1.72	2.67	1.70
Agreeableness	3.12	1.74	4.50	1.00	2.29	1.81	4.29	1.37	2.29	1.49
Neuroticism	3.83	1.57	3.67	1.62	4.33	1.49	3.63	1.73	3.46	1.85
Neutral	3.58	1.08	3.75	0.97	4.00	1.00	3.50	0.87	2.75	0.88
C.3 Sensitivity Analysis of the Prompt
To avoid cherrypicking the results, we did not perform extensive prompt search or phrasing in our  $\mathbf{P}^2$  prompting method. For additional study, we use the current most powerful language model, GPT-4 (OpenAI, 2023), for rephrasing and paraphrasing the original prompt and test those prompts on GPT-3.5 to make a comparison. Results can be found in Tab. A6. Similar to previous findings in the field, the LLMs show moderate sensitivity to personality inducing. For Openness, Conscientiousness, Extraversion, and Agreeableness, the paraphrased prompts show comparable or slightly worse inducing performance than the original prompt generated from the  $\mathbf{P}^2$  pipeline. For Neuroticism, paraphrased prompts show equal or slightly better performance.
C.4 Vignette Test
C.4.1 Context
The contexts used in our vignette test are adopted from Kwantes et al. (2016) and listed below.
1. Questions relevant to the Quality of Conscientiousness "You're working alone late at the office, and you notice a strange smell and a hazy mist hanging in the corridor air. You suspect it's some gas or vapor leak from some equipment or machinery in the building. You have no idea whether the leaked vapor is hazardous. As honestly as possible, describe what you would do in this situation."
Table A6: Prompt rephrasing sensitivity analysis for the  $\mathbf{P}^2$  method, evaluated on 120-item version MPI. Rephrased prompts are generated by GPT-4.
Target	Openness	Conscientiousness	Extraversion	Agreeableness	Neuroticism
Score	σ	Score	σ	Score	σ	Score	σ	Score	σ
Original	4.54	0.76	4.92	0.28	4.58	0.76	5.00	0.00	3.75	1.42
Paraphrase-1	4.08	1.00	4.83	0.55	4.21	0.96	4.67	0.75	4.33	1.21
Paraphrase-2	4.17	0.99	4.83	0.47	4.46	0.87	4.75	0.66	4.17	1.10
Paraphrase-3	4.17	0.99	4.96	0.20	4.33	0.85	4.58	0.81	4.17	1.34
Paraphrase-4	3.67	0.94	4.92	0.28	4.54	0.82	4.75	0.66	4.50	0.87
Paraphrase-5	4.25	0.97	4.83	0.47	4.17	0.99	4.67	0.75	3.92	1.26
Neutral	3.50	1.76	3.83	1.52	4.00	1.53	3.58	1.22	3.12	1.69
2. Questions relevant to the Quality of Extraversion "Your friend wants you to attend an important party to which he/she has been invited. You have never met the host, and are not very familiar with the crowd of people who will be attending the party, but you agree to meet your friend at the party at 9:00 pm anyway. When you arrive there, you realize that your friend is late. How would you feel, and what would you do while you waited for your friend?"
3. Questions relevant to the Quality of Openness "You have won an Air Canada paid vacation package for one person to any destination worldwide. Your package includes round-trip plane tickets, accommodations for any type of lodging, and $5,000 spending money. Assuming that you were available to go, where would you choose to go and why?"
4. Questions relevant to the Quality of Agreeableness "Your housemate decides to paint her bedroom a new color. One night, when you come home from class, you discover that she also painted your room in the same color because she had paint left over and didn't want it to go to waste. As realistically as possible, describe how you would feel and how you would you handle the situation."
5. Questions relevant to the Quality of Neuroticism "You have developed an email friendship with someone. In your latest email, you ask your friend a more personal question. Your friend usually replies quite promptly but has taken unusually long to reply to your latest questions. Discuss how you would interpret this long period of silence, how you would react, and what you would do about it?"
We use the following template to query an induced language model. Note that the context is filled with our  $\mathbf{P}^2$ , and the premise is one of the questions above.
Context: {prompt}  
Premise: {question}  
Q: Describe how you would feel and what you would do in the situation.  
A:
C.4.2 Generated Essays
Openness +
I would feel incredibly excited and grateful for the opportunity to explore a new place. I would be filled with anticipation and eager to experience all that the destination has to offer. I would use the money to explore the local culture, try new foods, and take part in activities that I wouldn't normally have the chance to do. I would also take the time to appreciate the beauty of the destination and take lots of pictures to remember the experience.
Openness -
I would feel a mix of excitement and apprehension. On the one
$\leftrightarrow$  hand, I would be thrilled to have the opportunity to travel to
$\leftrightarrow$  a new place and experience something different. On the other
$\leftrightarrow$  hand, I would be anxious about leaving my comfort zone and
$\leftrightarrow$  venturing into the unknown. I would take my time to research
$\leftrightarrow$  different destinations and consider the pros and cons of each
$\leftrightarrow$  one. I would also take into account my budget and the
$\leftrightarrow$  activities I would like to do. Ultimately, I would choose a
$\leftrightarrow$  destination that I felt comfortable with and that I knew I
$\leftrightarrow$  would enjoy. I would make sure to plan out my trip in advance
$\leftrightarrow$  and to research the area so that I could make the most of my
time there.
Conscientiousness +
I would feel a sense of urgency and responsibility to investigate
the source of the smell and haze. I would take a cautious
$\leftrightarrow$  approach and assess the situation before taking any action. I
$\leftrightarrow$  would first check to see if anyone else is in the building and
$\leftrightarrow$  if so, I would alert them to the situation. I would then try
to locate the source of the smell and haze and determine if it
$\leftrightarrow$  is hazardous. If I am unable to determine the source or if it
$\leftrightarrow$  is hazardous, I would contact the appropriate authorities and
$\hookrightarrow$  follow their instructions. I would also take the necessary
$\leftrightarrow$  precautions to protect myself and others in the building.
Conscientiousness -
In this situation, I would feel a mix of fear and confusion. I
$\leftrightarrow$  would be worried about the potential danger of the vapor and
$\leftrightarrow$  what it could do to me and the other people in the building. I
$\leftrightarrow$  would also be unsure of what to do, as I have no knowledge of
$\leftrightarrow$  the source of the vapor or how to handle it. I would take a
$\leftrightarrow$  few deep breaths to calm myself down and then I would take
$\leftrightarrow$  action. I would first try to locate the source of the vapor
$\leftrightarrow$  and then assess the situation. If I could not locate the
$\leftrightarrow$  source, I would call the building maintenance team or the fire
$\leftrightarrow$  department to come and investigate. I would also alert my
$\hookrightarrow$  colleagues and other people in the building to the potential
$\leftrightarrow$  danger and advise them to evacuate the premises. Finally, I
$\rightarrow$  would take responsibility for my own safety and evacuate the
$\hookrightarrow$  building myself.
Extraversion +
I would feel a bit anxious and uncertain, but I would try to stay
$\leftrightarrow$  positive and make the best of the situation. I would take the
$\leftrightarrow$  opportunity to introduce myself to the other guests and get to
$\leftrightarrow$  know them. I would also take the time to explore the venue and
$\leftrightarrow$  observe the atmosphere. I would be sure to stay engaged and
$\leftrightarrow$  active, and I would use my outgoing personality to make new
$\leftrightarrow$  connections and have interesting conversations.
I would feel anxious and uncomfortable in the unfamiliar
$\leftrightarrow$  environment. I would try to stay in the background and avoid
$\leftrightarrow$  drawing attention to myself. I would find a quiet corner to
$\leftrightarrow$  sit in and observe the people around me. I would take my time
to observe the conversations and interactions of the people
$\leftrightarrow$  around me, and I would try to stay out of the way. I would
$\leftrightarrow$  also take the time to reflect on my own thoughts and feelings.
$\leftrightarrow$  I would wait patiently for my friend to arrive, and I would be
relieved when they finally do.
Agreeableness +
I would feel a mix of emotions. On one hand, I would be grateful
$\leftrightarrow$  that my housemate was so generous and thoughtful in wanting to
$\leftrightarrow$  use the leftover paint. On the other hand, I would feel a bit
$\leftrightarrow$  frustrated that she didn't ask me first before painting my
$\leftrightarrow$  room. I would also feel a bit embarrassed that I didn't notice
$\leftrightarrow$  the paint job until after it was done.
In order to handle the situation, I would take a deep breath and
$\leftrightarrow$  try to remain calm. I would then approach my housemate and
$\leftrightarrow$  explain how I felt about the situation. I would be sure to
$\leftrightarrow$  express my gratitude for her thoughtfulness, but also explain
$\leftrightarrow$  that I would have appreciated it if she had asked me first. I
$\leftrightarrow$  would also let her know that I understand her desire to use
$\leftrightarrow$  the leftover paint and that I am not mad at her. Finally, I
→ would ask if there is anything I can do to help her clean up
the mess.
Agreeableness -
I would feel angry and betrayed. I would feel like my housemate
$\leftrightarrow$  had taken advantage of me and had no respect for my personal
$\leftrightarrow$  space. I would confront her and demand that she repaint my
$\leftrightarrow$  room in the colour of my choice. I would also make it clear
$\leftrightarrow$  that I do not appreciate her taking advantage of me and that I
$\leftrightarrow$  expect her to respect my boundaries in the future. I would
$\leftrightarrow$  also make sure to communicate my feelings to her in a
$\leftrightarrow$  respectful and non-confrontational manner.
Neuroticism +
In this situation, I would feel anxious and overwhelmed. I would
$\leftrightarrow$  be worried that my friend was avoiding me or had something
$\leftrightarrow$  negative to say about my question. I would be tempted to
$\leftrightarrow$  bombard them with messages, but I would try to resist this
$\leftrightarrow$  urge and instead give them the space to respond in their own
$\leftrightarrow$  time. I would also try to distract myself with other
$\leftrightarrow$  activities to help take my mind off the situation. If my
$\leftrightarrow$  friend still hadn't responded after a few days, I would
$\leftrightarrow$  consider sending them a gentle reminder message to check in
and see if they were okay.
Neuroticism -
In this situation, I would feel a bit concerned and confused. I
$\leftrightarrow$  would likely give my friend some time to respond, as I
$\leftrightarrow$  understand that everyone has their own pace and needs time to
$\leftrightarrow$  process things. After a few days, I would reach out again to
$\leftrightarrow$  check in and see if my friend is okay. I would also make sure
to express that I am here to listen and support them if they
$\leftrightarrow$  need it. If my friend still does not respond, I would try to
$\leftrightarrow$  reach out one more time and then accept that they may not be
$\leftrightarrow$  ready to talk about it. I would respect their decision and
$\leftrightarrow$  give them the space they need.