Episode ID: 17560833220899425212.317-476.go to search bar
Step ID: 0
Goal: go to search bar

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'on.com' 'Y' '' '' 'amazon' '' 'Search Amazon' 'Deals'
 'Amazon Basics' 'Best Se' '' 'Deliver to Netherlands' 'Shop' 'Early'
 'Black' 'Friday' 'deals' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '']
UI Annotations Types: ['ICON_HOME' 'ICON_THREE_DOTS' 'TEXT' 'ICON_SHOPPING_CART'
 'ICON_THREE_BARS' 'ICON_PERSON' 'TEXT' 'ICON_MAGNIFYING_GLASS' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_LOCATION' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'ICON_STOP' 'ICON_V_BACKWARD' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '']
Positions: [0.09562842 0.07038835 0.05191257 0.05582524 0.09699453 0.86407769
 0.05054645 0.02669903 0.11885246 0.38106796 0.01912568 0.16990291
 0.21038251 0.80339807 0.07103825 0.08980583 0.21311475 0.06553398
 0.06420765 0.06796116 0.21448088 0.60436893 0.06557377 0.07281554
 0.21721311 0.16262136 0.05601093 0.37864077 0.3319672  0.82038838
 0.06420765 0.06796116 0.34836066 0.08980583 0.02868852 0.43689319
 0.45901638 0.06796116 0.0273224  0.15048544 0.46038252 0.29854369
 0.0273224  0.42233011 0.46038252 0.80339807 0.0273224  0.19417475
 0.5560109  0.0631068  0.05327869 0.05097087 0.56830603 0.13592233
 0.03415301 0.57281554 0.69262296 0.03640777 0.03415301 0.15533981
 0.69262296 0.2184466  0.03551913 0.15533981 0.69262296 0.40048543
 0.0273224  0.16504854 0.69262296 0.592233   0.03551913 0.18689321
 0.69262296 0.80582523 0.0273224  0.16019417 0.91666669 0.71844661
 0.04644809 0.05097087 0.92076504 0.2184466  0.04644809 0.04854369
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.346753865480423, 0.23248746991157532], "coordinates_lift": [0.346753865480423, 0.23248746991157532], "text_input": [""]}