Episode ID: 9209656723816866621.345-353.Select main characters
Step ID: 0
Goal: Select main characters

Previous Actions:


Current Screen:
UI Annotations Text: ['Google' 'V' '' '' 'sandman' 'series' 'order' 'Shopping' 'All' 'Videos'
 'Books' 'News' 'Images' 'Maps' '' 'The Sandman' '' 'Comic book series'
 'Main characters' 'Overvievw' 'Characters' 'Books' 'New' 'NEIL GAIMAN'
 'SANOMAN' 'NEIL GAIMAN' 'SANOMAN' 'T ANOMAN' 'Gann' 'Dreludes8'
 'YpocIurnes' 'LLCGIEem' 'The Sandman Vol.' 'The Sandman:' 'The'
 'The Sandman:' "Doll's" 'Preludes' 'House' '1:' '&.' 'Dream Country'
 '1989' '1989' '1991' 'wistun' 'Neil GAIMAN' 'NEIL GAIMAN' 'SANOMA'
 'The SANOMAN' '&NDLESS NIGHTS' 'Mists' '' '*' '' 'Collections' 'Discover'
 'Snapshot' 'Search' 'More' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '']
UI Annotations Types: ['TEXT' 'TEXT' 'ICON_MIC' 'ICON_MAGNIFYING_GLASS' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_NOTIFICATIONS'
 'TEXT' 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_MAGNIFYING_GLASS' 'TEXT' 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT'
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.03881579 0.39166668 0.03289474 0.22083333 0.03947368 0.87777776
 0.02105263 0.03888889 0.10592105 0.88194442 0.03421053 0.02916667
 0.1118421  0.08333334 0.02697368 0.03472222 0.11973684 0.18888889
 0.01184211 0.1375     0.11973684 0.33888888 0.01184211 0.0875
 0.11973684 0.43888888 0.01184211 0.07777778 0.17236842 0.72638887
 0.01381579 0.12916666 0.17302631 0.04861111 0.01118421 0.03194445
 0.17302631 0.43194443 0.01052632 0.09305555 0.17302631 0.58472222
 0.01118421 0.08194444 0.17368421 0.14166667 0.01052632 0.075
 0.17368421 0.27638888 0.01315789 0.09722222 0.17368421 0.91666669
 0.01315789 0.05694444 0.23355263 0.90694445 0.02697368 0.03055556
 0.23421052 0.03888889 0.01776316 0.30277777 0.23486842 0.81805557
 0.02302632 0.01388889 0.26447368 0.03888889 0.01118421 0.24027778
 0.30592105 0.63749999 0.01118421 0.20833333 0.30657893 0.00694444
 0.00986842 0.11805555 0.30657893 0.22083333 0.00986842 0.14305556
 0.30657893 0.46250001 0.01052632 0.07638889 0.30657893 0.94305557
 0.00986842 0.05416667 0.3763158  0.10138889 0.00921053 0.17638889
 0.38355264 0.35416666 0.02171053 0.25416666 0.39013159 0.69722223
 0.01381579 0.16666667 0.40263158 0.06111111 0.02105263 0.24722221
 0.40328947 0.64444447 0.02039474 0.30555555 0.42105263 0.41805556
 0.02565789 0.18611111 0.47697368 0.38333333 0.01118421 0.09583333
 0.48421052 0.38611111 0.01381579 0.11944444 0.58684212 0.38194445
 0.01052632 0.11944444 0.60986841 0.37777779 0.01315789 0.23333333
 0.61052632 0.05694444 0.01052632 0.18611111 0.61052632 0.25138888
 0.01052632 0.04861111 0.61052632 0.6875     0.01052632 0.18472221
 0.63026315 0.05833333 0.01052632 0.06666667 0.63026315 0.40416667
 0.01052632 0.11111111 0.63092107 0.13611111 0.00986842 0.08055556
 0.63092107 0.37361112 0.00986842 0.01944445 0.63092107 0.52638888
 0.00986842 0.02777778 0.63092107 0.68888891 0.01184211 0.19305556
 0.65592104 0.05833333 0.00921053 0.05277778 0.65592104 0.37361112
 0.00921053 0.05       0.65592104 0.68888891 0.00921053 0.04861111
 0.69999999 0.25694445 0.01315789 0.06388889 0.71249998 0.04305556
 0.01710526 0.27916667 0.71315789 0.70416665 0.01381579 0.18888889
 0.7157895  0.34999999 0.02828947 0.2361111  0.73552632 0.05
 0.025      0.2736111  0.75986844 0.08194444 0.01381579 0.19166666
 0.82828945 0.35277778 0.02105263 0.10416666 0.89144737 0.48055556
 0.025      0.03055556 0.89342105 0.09861111 0.02236842 0.04722222
 0.89802629 0.8597222  0.01184211 0.03333334 0.92500001 0.62361109
 0.00986842 0.12638889 0.92565787 0.07222223 0.00855263 0.10138889
 0.92565787 0.25694445 0.01118421 0.10694444 0.92565787 0.45972222
 0.00855263 0.07777778 0.92565787 0.84861112 0.00855263 0.05694444
 0.95723683 0.19166666 0.02697368 0.02777778 0.95855266 0.4861111
 0.02565789 0.02916667 0.95855266 0.77222222 0.02697368 0.02916667
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.31735900044441223, 0.7354112267494202], "coordinates_lift": [0.31735900044441223, 0.7354112267494202], "text_input": [""]}