---
author:
- |
    Ilya Kulikov\
    New York University\
    [kulikov@cs.nyu.edu]{}\
    Alexander H. Miller\
    Facebook AI Research\
    Kyunghyun Cho\
    New York University\
    Facebook AI Research\
    CIFAR Azrieli Global Scholar\
    Jason Weston\
    Facebook AI Research\
    New York University\
title: |
     Importance of Search and Evaluation Strategies\
    in Neural Dialogue Modeling 
---

  Person                                                                      Model
  ------------------------------------------ --- ----------------------------------
  i love cooking but i also enjoy fishing.              my favorite color is yellow. 
  l also love comic books.                               i workout four hours a day. 
  hey my name is larry and i am a chef.             gymnastics is my favorite sport. 
                                                      i’m a gold medalist olympian. 
                                              0  
                                              1  
                                              2  
                                              3  
                                              4  
                                              5  

  Person                                                                                       Model
  ---------------------------------------------- --- -----------------------------------------------
  i can move objects with my mind.                               i will be released in about a month. 
  i was born with my heart outside my body.                                 i’m here for shoplifting. 
  i am a boy.                                                                             i feel old. 
  i had to have a transplant.                           i’m currently in a juvenile detention center. 
  since the surgery i have had strange powers.                 my mom is coming to visit me tomorrow. 
                                                  0  
                                                  1  
                                                  2  
                                                  3  
                                                  4  
                                                  5  

  Person                                                                   Model
  ---------------------------------------------- --- ---------------------------
  my favorite band is the who.                          i like to make time stop. 
  my favorite food is pizza with black olives.                 i’m a little girl. 
  i have never been out of ohio.                             i live in the cloud. 
  i work for our local supermarket.                           i have superpowers. 
  i’ve a cat named spook.                             
                                                  0  
                                                  1  
                                                  2  
                                                  3  
                                                  4  
                                                  5  

  Person                                                                                  Model
  -------------------------------------- --- --------------------------------------------------
  i like to watch nhl hockey.                                             i do not like chicken. 
  i live is a rural farming community.          i recently got an apartment with my best friend. 
  my husband is adopted.                            i work at a bar at night to pay for college. 
  i enjoy coloring books.                                      i’m in college to become a nurse. 
  i’ve a german shepherd dog.                 
                                          0  
                                          1  
                                          2  
                                          3  
                                          4  
                                          5  

  Person                                                                                        Model
  ---------------------------------------------- --- ------------------------------------------------
  my dream car is a rolls royce ghost.                                                     i feel old. 
  i like shopping.                                      i am currently in a juvenile detention center. 
  my family doesn’t support my career choices.                  my mom is coming to visit me tomorrow. 
  i currently work for a watch dealer.                            i will be released in about a month. 
                                                                            i’m here for shoplifting. 
                                                  0  
                                                  1  
                                                  2  
                                                  3  
                                                  4  
                                                  5  

  Person                                                                                   Model
  -------------------------------------- --- ---------------------------------------------------
  i have one older sister.                             i have two grown children who never visit. 
                                                 i used to be pretty but time has not been kind. 
  my favourite artist is travis scott.                                   i’m a 56 year old woman. 
  i like playing basketball.                    i used to be a painter but now i’m a housekeeper. 
  my mother is a dentist.                     
                                          0  
                                          1  
                                          2  
                                          3  
                                          4  
                                          5  

  Person                                                                                   Model
  ------------------------------------------------ --- -----------------------------------------
  i’ve short hair.                                                    i’m terrified of scorpions. 
  two dogs live with me.                                   i’m employed by the us postal service. 
  i like doing the treadmill and rowing machine.          i have a german shepherd named barnaby. 
  eating is something i do when i’m bored.                      my father drove a car for nascar. 
                                                    0  
                                                    1  
                                                    2  
                                                    3  
                                                    4  
                                                    5  

  Person                                                                                          Model
  --------------------------------------------------------- --- ---------------------------------------
  i graduated from yale in 2011 with a degree in finance.                   i’m a professional wrestler. 
  my parents are very wealthy bankers.                                i volunteer in a homeless shelter. 
  i grew up in manhattan.                                          in my spare time i do volunteer work. 
  i plan to go to business school next year.                         i like to workout a a times a week. 
  i drive a bmw.                                                            i enjoy being around people. 
                                                             0  
                                                             1  
                                                             2  
                                                             3  
                                                             4  
                                                             5  

  Person                                                                     Model
  ------------------------------------------ --- ---------------------------------
  i’m in an open polyamorous relationship.           i’m now looking for a new job. 
  i also have a dog walking business.               my daughter is a child prodigy. 
  i have three dogs.                                                 i am a doctor. 
  my father was a door to door salesman.               my favorite movie is friday. 
  i like to watch the olympics.                   
                                              0  
                                              1  
                                              2  
                                              3  
                                              4  
                                              5  

  Person                                                                             Model
  ---------------------------------------- --- -------------------------------------------
  i faint at the sight of blood.                           my favorite movie is mean girls. 
                                                                       i’m a party animal. 
  my dream in life is to work from home.                    i am deathly afraid of heights. 
  i dye my hair every three months.               i help out at the food bank occasionally. 
                                                                    i own a cat and a dog. 
                                            0  
                                            1  
                                            2  
                                            3  
                                            4  
                                            5  

  Person                                                                     Model
  ------------------------------- --- --------------------------------------------
  i enjoy american sports.                                          i am a plumber. 
  i have a children and a dogs.          my favorite ice cream flavor is chocolate. 
  i own a house in florida.                          my wife and kids are the best. 
                                                            i have three children. 
                                   0  
                                   1  
                                   2  
                                   3  
                                   4  
                                   5  

  Person                                                                               Model
  ---------------------------------- --- ---------------------------------------------------
  i am deathly afraid of heights.                               i make straight as in school. 
  i am a party animal.                      when i grow up i want to be a physical therapist. 
  my favorite movie is mean girls.                             i am currently in high school. 
  i own a cat and a dog.                                    i won homecoming queen this year. 
                                      0  
                                      1  
                                      2  
                                      3  
                                      4  
                                      5  

  Person                                                                                   Model
  ------------------------------------------ --- -----------------------------------------------
  i’ve three dogs.                                                   i have three arabian horses. 
  i like to watch the olympics.                                           i help tend the fields. 
  i’m in an open polyamorous relationship.                                 my father is a farmer. 
  i also have a dog walking business.                                      i like to ride horses. 
  my father was a door to door salesman.            i like to listen to rock music while working. 
                                              0  
                                              1  
                                              2  
                                              3  
                                              4  
                                              5  
                                              6  

  Person                                                            Model
  ------------------------------ --- ------------------------------------
  i speak chinese.                         i live in a three storey house. 
  my father is an electrician.          my family is continuously growing. 
  i play ping pong.                        i enjoy long walks with my dog. 
  i love chocolate bars.                i am a professional tennis player. 
                                                 i’m married to a doctor. 
                                  0  
                                  1  
                                  2  
                                  3  
                                  4  
                                  5  

  Person                                                                     Model
  ------------------------------------ --- ---------------------------------------
  my family is continuously growing.                   i’m a professional wrestler. 
  i enjoy long walks with my dog.                i volunteer in a homeless shelter. 
  i’m a professional tennis player.           in my spare time i do volunteer work. 
  i live in a three storey house.               i like to workout a a times a week. 
                                                      i enjoy being around people. 
                                        0  
                                        1  
                                        2  
                                        3  
                                        4  
                                        5  

  Person                                                             Model
  --------------------------- --- ----------------------------------------
  i’m a little girl.                 my dream in life is to work from home. 
  i’m very lonely.                        i dye my hair every three months. 
  i have superpowers.              
  i live in the cloud.             
  i like to make time stop.        
                               0  
                               1  
                               2  
                               3  
                               4  
                               5  

  Person                                                                       Model
  --------------------------------------- --- --------------------------------------
  i walk dogs for a living.                                    my husband is adopted. 
  my parents taught me survival skills.                   i like to watch nhl hockey. 
  i’m an avid kayaker.                           i live is a rural farming community. 
                                                         i’ve a german shepherd dog. 
                                           0  
                                           1  
                                           2  
                                           3  
                                           4  
                                           5  

  Person                                                                                         Model
  -------------------------------------------------- --- ---------------------------------------------
  i just got a job working in a gas station.                i love to sing songs from the movie frozen. 
                                                              i love to go to disney world every year. 
  i was adopted at a young age to an older couple.            i play with my friends on the playground. 
  i’m terrified of clowns due to childhood trauma.                              i’m in the third grade. 
                                                                mickey mouse is my favorite character. 
                                                      0  
                                                      1  
                                                      2  
                                                      3  
                                                      4  
                                                      5  

  Person                                                                        Model
  ------------------------------------- --- -----------------------------------------
  i diet a lot.                                            i’m terrified of scorpions. 
  i’m high maintenance.                         i’m employed by the us postal service. 
  i love listening to britney spears.          i have a german shepherd named barnaby. 
  i like to tan in tanning beds.                     my father drove a car for nascar. 
  i love spending money.                     
                                         0  
                                         1  
                                         2  
                                         3  
                                         4  
                                         5  

  Person                                                                    Model
  ---------------------------------------------- --- ----------------------------
  my family doesn’t support my career choices.          i don’t have many friends. 
  i currently work for a watch dealer.                
  my dream car is a rolls royce ghost.                       i love to play pobox. 
  i often shop for shoes and watches.                               i hate school. 
  i like shopping.                                         i’m a 12 year old girl. 
                                                  0  
                                                  1  
                                                  2  
                                                  3  
                                                  4  
                                                  5  

  Person                                                                                       Model
  ------------------------------------------- --- --------------------------------------------------
  i’m a descendant of christopher columbus.                                    i do not like chicken. 
  i’m an art major in college.                           i work at a bar at night to pay for college. 
  i have a weakness for fish and chips.                             i’m in college to become a nurse. 
  i visit europe twice a year.                       i recently got an apartment with my best friend. 
                                               0  
                                               1  
                                               2  
                                               3  
                                               4  
                                               5  

  Person                                                                  Model
  --------------------------------------- --- ---------------------------------
  i’m a librarian.                                 i like to play with my dolls. 
  i really like to travel.                       my best friend lives next door. 
  i have visited spain a times.                        i do not pick up my toys. 
  i think i will retire in a few years.                     i have a pet turtle. 
  i am 60years old.                            
                                           0  
                                           1  
                                           2  
                                           3  
                                           4  
                                           5  

  Person                                                                                      Model
  ------------------------------------------ --- --------------------------------------------------
  horror movies are my favorites.                                  my favorite food is mexican food. 
  my father used to work for home depot.                                  i’m a construction worker. 
  i’ve a son who is in junior high school.                            my favorite band is aerosmith. 
                                                   i’ve been working since i was sixteen years old. 
                                              0  
                                              1  
                                              2  
                                              3  
                                              4  
                                              5  

  Person                                                                      Model
  ---------------------------------- --- ------------------------------------------
  my favorite color is yellow.                           i do not have a smartphone. 
  i workout four hours a day.               i’ve amazing children and grandchildren. 
  gymnastics is my favorite sport.           i am retired and living the great life. 
  i’m a gold medalist olympian.                            i can sew my own clothes. 
                                                     i had cancer but its gone now. 
                                      0  
                                      1  
                                      2  
                                      3  
                                      4  
                                      5  

  Person                                                                              Model
  --------------------------------------------------- --- ---------------------------------
  i wear a motorbike helmet to protect my head.                i like to play with my dolls. 
  i’ve light skin with big brown eyes.                       my best friend lives next door. 
  its red with blue stripe so it shiny when i race.                i do not pick up my toys. 
  my main transportation is my motorbike.                               i have a pet turtle. 
                                                       0  
                                                       1  
                                                       2  
                                                       3  
                                                       4  
                                                       5  

  Person                                                                                Model
  ------------------------------------------------- --- -------------------------------------
  i eat a raw diet.                                        i helped design the game starcraft. 
  i am an economics major.                                                     i am a recluse. 
  i just bought a house recently.                        
  i see the rolling stones in concert every year.               i am a famous twitch streamer. 
  i am married with two kids.                            
                                                     0  
                                                     1  
                                                     2  
                                                     3  
                                                     4  
                                                     5  

  Person                                                                                   Model
  -------------------------------------------------------------- --- ---------------------------
  i work in it and have been at the same company for 15 years.               i live in the cloud. 
  i own a house in florida.                                                   i am a little girl. 
  i enjoy american sports.                                                      i’ve superpowers. 
  i am a male.                                                          i like to make time stop. 
  i have a children and a dogs.                                       
                                                                  0  
                                                                  1  
                                                                  2  
                                                                  3  
                                                                  4  
                                                                  5  

  Person                                                                           Model
  ----------------------------------------- --- ----------------------------------------
  i attend church every week.                           i have a black lab named trooper. 
  i have a dogs.                                   my favorite activity is rock climbing. 
  i work as a school teacher.                                  i’m a mechanical engineer. 
  i enjoy gardening and walking outdoors.              i like to go hiking in the spring. 
                                                                     i live in colorado. 
                                             0  
                                             1  
                                             2  
                                             3  
                                             4  
                                             5  

  Person                                                                             Model
  -------------------------------------------- --- ---------------------------------------
  i do not drink soda.                                    i do like watching cooking shows. 
  i like to take walks.                               i love rollercoasters and sky diving. 
  i like to eat hamburgers and french fries.          hello i just moved here from germany. 
  i’ve a boyfriend.                                         i am a vegan and i love hummus. 
  i live in a house.                                
                                                0  
                                                1  
                                                2  
                                                3  
                                                4  
                                                5  

  Person                                                            Model
  --------------------------------------- --- ---------------------------
  my favourite food is shawarma.                 i like to make time stop. 
  i am in the army.                                     i’m a little girl. 
  i live in canada.                                   i live in the cloud. 
  i did not graduate high school.                      i have superpowers. 
  my grandfather served in world war a.       
                                           0  
                                           1  
                                           2  
                                           3  
                                           4  
                                           5  

  Person                                                                                    Model
  -------------------------------------------- --- ----------------------------------------------
  i have amazing children and grandchildren.                      coffee is my preferred beverage. 
  i had cancer but its gone now.                                   i coach little league baseball. 
  i do not have a smartphone.                                                    i have five sons. 
  i am retired and living the great life.                                      i drive a mini van. 
                                                     i also like a glass of wine in the evenings. 
                                                0  
                                                1  
                                                2  
                                                3  
                                                4  
                                                5  

  Person                                                          Model
  ------------------------------------ --- ----------------------------
  my favourite skater is rob dryden.          i don’t have many friends. 
  i’m always wearing a hat.                               i hate school. 
  i’m a skateboarder.                           i am a 12 year old girl. 
  i’ve a broken arm.                        
  my friends are all skateboarders.         
                                        0  
                                        1  
                                        2  
                                        3  
                                        4  
                                        5  

  Person                                                                              Model
  --------------------------------------------- --- ---------------------------------------
  the holidays make me depressed.                            i did not graduate high school. 
  i spend my time bird watching with my cats.                              i live in canada. 
  my age is too old to say.                            my grandfather served in world war a.
  i’m an animal activist.                                     my favourite food is shawarma. 
  i have rainbow hair.                               
                                                 0  
                                                 1  
                                                 2  
                                                 3  
                                                 4  
                                                 5  

  Person                                                                           Model
  ----------------------------- --- ----------------------------------------------------
  i like to play chess.                                          i’m a 56 year old woman. 
  i don’t drink alcohol.                         i fantasize about taking over the world. 
  i am in my thirties.                     i used to be pretty but time hasn’t been kind. 
  i love taking bubble baths.          i used to be a painter but now i am a housekeeper. 
                                 0  
                                 1  
                                 2  
                                 3  
                                 4  
                                 5  

  Person                                                                         Model
  --------------------------------- --- ----------------------------------------------
  my daughter is a child prodigy.                       i coach little league baseball. 
  i am a doctor.                                                        i’ve five sons. 
  my favorite movie is friday.                         coffee is my preferred beverage. 
  i enjoy going to the park.                                        i drive a mini van. 
  i am now looking for a new job.          i also like a glass of wine in the evenings. 
                                     0  
                                     1  
                                     2  
                                     3  
                                     4  
                                     5  

  Person                                                                          Model
  ---------------------------------- --- ----------------------------------------------
  i’ve not spoken in three months.                     i like to spend my money on cars. 
  i live in alaska.                                   i watch too much tv in spare time. 
  i like meditation.                             i have never had a steady relationship. 
  i’m a buddhist.                                                      i work from home. 
                                           i go to the gym most days just to socialize. 
                                      0  
                                      1  
                                      2  
                                      3  
                                      4  
                                      5  

  Person                                                              Model
  ------------------------- --- -------------------------------------------
  i’m scared of dying.                    i’m a swim coach at my local pool. 
  knitting is my passion.                    my family and i are from india. 
  i’ve a dogs.                     i’m studying to be a computer programmer. 
                                
                             0  
                             1  
                             2  
                             3  
                             4  
                             5  

  Person                                                                            Model
  -------------------------------------------- --- --------------------------------------
  i am studying to be a computer programmer.                  i drive a nissan pathfinder. 
  i’m a swim coach at my local pool.                              i have short brown hair. 
                                                                      i met taylor swift. 
  my favorite music genre is death metal.                i am a convenience store manager. 
  my family and i are from india.                     my favourite music is country music. 
                                                0  
                                                1  
                                                2  
                                                3  
                                                4  
                                                5  

  Person                                                                          Model
  ----------------------------------- --- ---------------------------------------------
  i drive a nissan pathfinder.                                   i’m in the third grade. 
  i have short brown hair.                        mickey mouse is my favorite character. 
  i met taylor swift.                           i love to go to disney world every year. 
  i am a convenience store manager.          i love to sing songs from the movie frozen. 
                                              i play with my friends on the playground. 
                                       0  
                                       1  
                                       2  
                                       3  
                                       4  
                                       5  

  Person                                                         Model
  ------------------------------ --- ---------------------------------
  my pets name is charlie.                         i have a pet turtle. 
  i produce music for artists.            i like to play with my dolls. 
  my favourite food is pizza.                  i don’t pick up my toys. 
  i drive a 2015 honda civic.           my best friend lives next door. 
                                  0  
                                  1  
                                  2  
                                  3  
                                  4  
                                  5  

  Person                                                                            Model
  ---------------------------------------- --- ------------------------------------------
  i’m terrified of scorpions.                                  i do not have a smartphone. 
  i’m employed by the us postal service.          i’ve amazing children and grandchildren. 
  my favorite color is grey.                       i am retired and living the great life. 
  my father drove a car for nascar.                              i can sew my own clothes. 
  i’ve a german shepherd named barnaby.                     i had cancer but its gone now. 
                                            0  
                                            1  
                                            2  
                                            3  
                                            4  
                                            5  

  Person                                                                                 Model
  ---------------------------------------------- --- -----------------------------------------
  i have brown curly hair.                                     i just moved into my first home. 
  i’ll graduate from high school in two years.          i’m expecting triplets in three months. 
  i like riding horses.                                                     i work at a school. 
  my bedroom is purple and lime green.                        i recently moved to this country. 
                                                               a already have a step children. 
                                                  0  
                                                  1  
                                                  2  
                                                  3  
                                                  4  
                                                  5  

  Person                                                                              Model
  --------------------------------------------------- --- ---------------------------------
  i am a musician and hope to make it big some day.                       i am a vegetarian. 
  i also work as a custodian to help pay the bills.               my favorite color is blue. 
  i play the piano and guitar and sing.                                        i am a woman. 
  my parents are not very supportive of my dream.            i enjoy sports such as running. 
                                                                              i am married. 
                                                       0  
                                                       1  
                                                       2  
                                                       3  
                                                       4  
                                                       5  

  Person                                                                                    Model
  -------------------------------------------- --- ----------------------------------------------
  i like to take walks.                               since the surgery i have had strange powers. 
  i don’t drink soda.                                    i was born with my heart outside my body. 
  i’ve a boyfriend.                                                    i had to have a transplant. 
  i like to eat hamburgers and french fries.                      i can move objects with my mind. 
                                                                                       i’m a boy. 
                                                0  
                                                1  
                                                2  
                                                3  
                                                4  
                                                5  

  Person                                                                                          Model
  -------------------------------------------------- --- ----------------------------------------------
  i play a lot of call of duty.                                        i take dance lessons once a week. 
  on weekends i do live action roleplaying events.                         i love new kids on the block. 
  i like donuts.                                                           i was born in the early 80 s.
  my favorite band is the insane clown posse.                            i also like old school hip hop. 
  i drive a ford pinto.                                     my favorite toy as a child as my lite brite. 
                                                      0  
                                                      1  
                                                      2  
                                                      3  
                                                      4  
                                                      5  

  Person                                                                                                          Model
  -------------------------------------------------- --- --------------------------------------------------------------
  i play a lot of call of duty.                             one of the languages that i’m currently studying is spanish. 
  on weekends i do live action roleplaying events.                                                      i am a musician. 
  i like donuts.                                                                    my favorite spanish word is trabajo. 
  my favorite band is the insane clown posse.                                                    i also study languages. 
  i drive a ford pinto.                                                             my next language to study is french. 
                                                      0  
                                                      1  
                                                      2  
                                                      3  
                                                      4  
                                                      5  

  Person                                                                          Model
  --------------------------------------- --- -----------------------------------------
  i walk dogs for a living.                      i enjoy gardening and walking outdoors. 
  i’m also a graduate student.                                              i’ve a dogs. 
  i am an avid kayaker.                                      i work as a school teacher. 
                                                                           i’m a woman. 
  my parents taught me survival skills.        
                                           0  
                                           1  
                                           2  
                                           3  
                                           4  
                                           5  

  Person                                                        Model
  ----------------------------- --- ---------------------------------
  i am a male.                         my best friend lives next door. 
  i own a house in florida.                         i’ve a pet turtle. 
  i’ve a children and a dogs.                 i don’t pick up my toys. 
  i enjoy american sports.               i like to play with my dolls. 
                                                           i am four. 
                                 0  
                                 1  
                                 2  
                                 3  
                                 4  
                                 5  

  Person                                               Model
  ----------------------- --- ------------------------------
  i live in alabama.                 my pets name is charlie. 
  i like tacos.                  i produce music for artists. 
  i’ve one brother.               my favourite food is pizza. 
  i have three sisters.           i drive a 2015 honda civic. 
                           0  
                           1  
                           2  
                           3  
                           4  
                           5  

  Person                                                                             Model
  -------------------------------------------- --- ---------------------------------------
  i am a plumber.                                        i volunteer in a homeless shelter. 
  my favorite ice cream flavor is chocolate.                   i’m a professional wrestler. 
  my wife and kids are the best.                        i like to workout a a times a week. 
  i have three children.                              in my spare time i do volunteer work. 
                                                              i enjoy being around people. 
                                                0  
                                                1  
                                                2  
                                                3  
                                                4  
                                                5  

  Person                                                                                 Model
  ---------------------------------------------- --- -----------------------------------------
  my bedroom is purple and lime green.                               my favorite color is grey. 
  i am a vegan.                                                    i am terrified of scorpions. 
  i like riding horses.                                 i have a german shepherd named barnaby. 
  i’ll graduate from high school in two years.                my father drove a car for nascar. 
  i have brown curly hair.                               i’m employed by the us postal service. 
                                                  0  
                                                  1  
                                                  2  
                                                  3  
                                                  4  
                                                  5  

  Person                                                                   Model
  ---------------------------------------------------- --- ---------------------
  my favorite band is aerosmith.                                    i like tacos. 
  i’m a construction worker.                                  i have one brother. 
  i have been working since i was sixteen years old.          i’ve three sisters. 
                                                                    i love dogs. 
  my favorite food is mexican food.                            i live in alabama. 
                                                        0  
                                                        1  
                                                        2  
                                                        3  
                                                        4  
                                                        5  

  Person                                                                                          Model
  --------------------------------------------- --- ---------------------------------------------------
  i’m in the third grade.                                     i have two grown children who never visit. 
  mickey mouse is my favorite character.                                        i’m a 56 year old woman. 
  i love to go to disney world every year.                      i fantasize about taking over the world. 
  i love to sing songs from the movie frozen.          i used to be a painter but now i’m a housekeeper. 
  i play with my friends on the playground.              i used to be pretty but time has not been kind. 
                                                 0  
                                                 1  
                                                 2  
                                                 3  
                                                 4  
                                                 5
