Episode ID: 9458469141559952046.564-814.Enter in the Google search bar: amazon.com and go to the amazon website
Step ID: 0
Goal: Enter in the Google search bar: amazon.com and go to the amazon website

Previous Actions:


Current Screen:
UI Annotations Text: ['G' '' 'Fearch.' '' 'target' '' 'walmart' '' 'newegg' '' 'costco' ''
 'amazon' 'Amazon' '' 'nearest grocery' 'store' '' 'nearest verizon store'
 '' 'news about the us stock market' '' 'good restaurant in las vegas' ''
 'what is the capital of germany?' '' 'good italian' 'restaurants' ''
 'what is the speed of a' 'bicycle?' 'how much does a 2 bedroom apartment'
 '' 'rent for in' 'san' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '']
UI Annotations Types: ['ICON_GOOGLE' 'ICON_MIC' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT'
 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT'
 'ICON_TIME' 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT'
 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT'
 'ICON_TIME' 'TEXT' 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT'
 'ICON_NAV_BAR_RECT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_CIRCLE' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.04629629 0.06296296 0.03981481 0.04444445 0.04907407 0.89444447
 0.03518518 0.02962963 0.05277778 0.15925926 0.03055556 0.14444445
 0.12685186 0.06851852 0.0287037  0.03333334 0.13796297 0.17407407
 0.01574074 0.08888889 0.19074073 0.06851852 0.03055556 0.03518518
 0.2        0.17592593 0.01388889 0.12777779 0.25370371 0.06851852
 0.03148148 0.03518518 0.26666668 0.17777778 0.01296296 0.11481482
 0.31759259 0.06851852 0.03055556 0.03333334 0.32777777 0.17592593
 0.01296296 0.10555556 0.38148147 0.06851852 0.02962963 0.03333334
 0.3888889  0.73148149 0.00925926 0.10740741 0.39074075 0.17592593
 0.01388889 0.12777779 0.44537038 0.06851852 0.0287037  0.03333334
 0.45555556 0.17777778 0.01574074 0.23888889 0.45555556 0.42962962
 0.01203704 0.07592592 0.50833333 0.06851852 0.0287037  0.03333334
 0.51759261 0.17777778 0.01296296 0.32222223 0.57037038 0.06851852
 0.02962963 0.03518518 0.58055556 0.17777778 0.01388889 0.4925926
 0.63425928 0.06666667 0.03148148 0.03703704 0.64444447 0.17592593
 0.01666667 0.43518519 0.69814813 0.06851852 0.03055556 0.03518518
 0.70740741 0.17592593 0.01759259 0.47962964 0.76111114 0.06851852
 0.03055556 0.03518518 0.77037036 0.17592593 0.01666667 0.17962962
 0.77314812 0.36851853 0.01203704 0.17222223 0.82592595 0.06851852
 0.0287037  0.03333334 0.83425927 0.17592593 0.01666667 0.33703703
 0.83425927 0.52592593 0.01666667 0.12222222 0.88796294 0.17777778
 0.01574074 0.61851853 0.8888889  0.06851852 0.0287037  0.03333334
 0.90833336 0.17777778 0.01296296 0.14444445 0.91111112 0.3351852
 0.01111111 0.0537037  0.9546296  0.77037036 0.02962963 0.02962963
 0.95555556 0.19074073 0.0287037  0.02962963 0.95555556 0.47962964
 0.02777778 0.03148148 0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 3, "action_description": "Describe what the action means if needed", "coordinates_touch": [-1.0, -1.0], "coordinates_lift": [-1.0, -1.0], "text_input": ["amazon.com"]}