Episode ID: 16059208899732570917.76-89.Go to the previous screen
Step ID: 0
Goal: Go to the previous screen

Previous Actions:


Current Screen:
UI Annotations Text: ['a' '' '' 'RE' 'ONEMO' 'ONEMOR' 'OneMore Boba Tea' 'ONE' '' '' '' '' ''
 '4.3 ★*tt' '(89)' 'Bubble tea store' 'PHOTOS' 'OVERVIEW' 'UPDATES' 'MENU'
 'REVIEWS' '(<)' '(' '' '' 'DIRECTIONS' 'SAVE' 'MESSAGE' 'SHARE PLACE' 'V'
 '' 'V' 'Dine-in' 'Takeout' 'Delivery' '2101'
 'Showers Dr, Mountain View, CA 94040, United' '' 'States' 'V'
 'Closes 8:00 PM' '' 'Open' 'Updated' 'by this business 11' 'weeks ago'
 'Menu' 'Place an order' 'Contact us now' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_MAGNIFYING_GLASS' 'ICON_THREE_DOTS' 'ICON_ARROW_BACKWARD' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_STAR' 'ICON_STAR' 'ICON_STAR'
 'ICON_STAR' 'ICON_STAR' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_CHAT' 'ICON_SHARE' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_CHECK' 'ICON_CHECK' 'ICON_CHECK' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_LOCATION' 'TEXT' 'ICON_V_DOWNWARD' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_RECT'
 'ICON_NAV_BAR_CIRCLE' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.04273504 0.78703701 0.02820513 0.03333334 0.04273504 0.91111112
 0.02905983 0.01851852 0.04444445 0.06111111 0.02478633 0.02962963
 0.06324787 0.69814813 0.02051282 0.04814815 0.2008547  0.16851851
 0.01282051 0.10185185 0.2017094  0.44999999 0.01452991 0.12777779
 0.33760685 0.04074074 0.01880342 0.4611111  0.35042736 0.87222224
 0.00598291 0.03333334 0.36752138 0.2        0.02051282 0.02037037
 0.36752138 0.23148148 0.02222222 0.02222222 0.36837608 0.09444445
 0.02051282 0.02222222 0.36837608 0.12962963 0.01965812 0.02222222
 0.36923078 0.16296296 0.01880342 0.02037037 0.37094018 0.03888889
 0.01709402 0.18518518 0.37350428 0.27592593 0.01367521 0.05
 0.40085471 0.04074074 0.01367521 0.24444444 0.46068376 0.85925925
 0.01282051 0.11666667 0.46153846 0.04074074 0.01111111 0.15185185
 0.46153846 0.27222222 0.01111111 0.12407407 0.46153846 0.48518518
 0.01111111 0.08148148 0.46153846 0.65370369 0.01111111 0.12222222
 0.51282054 0.78518516 0.03247863 0.1        0.51367521 0.50925928
 0.03504274 0.0537037  0.51367521 0.57037038 0.02820513 0.03333334
 0.51452994 0.82222223 0.02820513 0.02962963 0.56239319 0.05185185
 0.01196581 0.18888889 0.56239319 0.3351852  0.01196581 0.07777778
 0.56239319 0.51666665 0.01196581 0.15185185 0.56239319 0.72962964
 0.01196581 0.21481481 0.61196584 0.25925925 0.02307692 0.02777778
 0.61196584 0.48703703 0.02307692 0.02777778 0.61282051 0.04629629
 0.02051282 0.02592593 0.61880344 0.1037037  0.01196581 0.1
 0.61880344 0.31481481 0.01196581 0.11851852 0.61880344 0.54444444
 0.01452991 0.11851852 0.67435896 0.17592593 0.01196581 0.07037037
 0.67435896 0.26296297 0.01282051 0.68518519 0.67606837 0.05185185
 0.02991453 0.02592593 0.70085472 0.17592593 0.01111111 0.09444445
 0.74871796 0.54444444 0.01709402 0.02407407 0.75042737 0.27777779
 0.01623932 0.24074075 0.75299144 0.04814815 0.02905983 0.03333334
 0.75299144 0.17592593 0.01367521 0.07777778 0.77692306 0.17777778
 0.01452991 0.12407407 0.77692306 0.31481481 0.01538462 0.28148147
 0.77692306 0.61296296 0.01452991 0.16111112 0.82905984 0.17777778
 0.01196581 0.08148148 0.88376069 0.17777778 0.01282051 0.21666667
 0.93675214 0.17777778 0.01025641 0.23148148 0.95811963 0.19629629
 0.02649573 0.02777778 0.95811963 0.77037036 0.02649573 0.03148148
 0.95897436 0.48148149 0.02564103 0.02962963 0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 5, "action_description": "Describe what the action means if needed", "coordinates_touch": [-1.0, -1.0], "coordinates_lift": [-1.0, -1.0], "text_input": [""]}