Episode ID: 15423641881971661783.169-247.Search and open amazon on chrome 
Step ID: 0
Goal: Search and open amazon on chrome 

Previous Actions:


Current Screen:
UI Annotations Text: ['G' '' 'Search or type web address' 'Computer Parts, PC Com.' '' ''
 'nevegg.com' 'Electronic..' 'Ariazan.c..' 'Dest' 'Buy .' 'Walmart.c..'
 'C' '' 'RECENT SEARCHES' '9' 'newegg' '' 'target' '9' 'bestbuy' 'Costco'
 'ST' 'wo' 'Big box store compary' '9' 'amazon.com' '9' 'newegg.' '9'
 'walmart' '9' "what's on the menu at chick-fil-a?" '9' 'walmart.com.' '9'
 'bestbuy.com' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_GOOGLE' 'ICON_MIC' 'TEXT' 'TEXT' 'ICON_SHARE' 'ICON_EDIT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_V_UPWARD' 'TEXT'
 'ICON_HISTORY' 'TEXT' 'ICON_HISTORY' 'TEXT' 'ICON_HISTORY' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_HISTORY' 'TEXT' 'ICON_HISTORY' 'TEXT'
 'ICON_HISTORY' 'TEXT' 'ICON_HISTORY' 'TEXT' 'ICON_HISTORY' 'TEXT'
 'ICON_HISTORY' 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_RECT' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '']
Positions: [0.03833333 0.04814815 0.03166667 0.03333334 0.03833333 0.9074074
 0.03166667 0.02962963 0.05       0.13703704 0.01833333 0.51481479
 0.10166667 0.13703704 0.01833333 0.48518518 0.105      0.69259262
 0.03       0.03333334 0.105      0.92592591 0.02833333 0.02962963
 0.12833333 0.12222222 0.01666667 0.21851853 0.23666666 0.03703704
 0.01166667 0.15185185 0.23833333 0.27037036 0.01       0.14814815
 0.23833333 0.50370371 0.01       0.05925926 0.23833333 0.5777778
 0.01       0.08148148 0.23833333 0.73333335 0.01       0.15925926
 0.23833333 0.96666664 0.01       0.01851852 0.28166667 0.92592591
 0.01833333 0.02222222 0.28666666 0.04074074 0.01333333 0.32962963
 0.33333334 0.04814815 0.02833333 0.03333334 0.34333333 0.13703704
 0.015      0.14814815 0.39500001 0.04814815 0.02666667 0.02962963
 0.405      0.13703704 0.01666667 0.10740741 0.45666668 0.04814815
 0.02666667 0.02962963 0.46333334 0.13703704 0.01666667 0.14814815
 0.51666665 0.13703704 0.02       0.12962963 0.52499998 0.02222222
 0.015      0.08888889 0.53833336 0.04074074 0.01166667 0.07037037
 0.54333335 0.13703704 0.015      0.37407407 0.58166665 0.04814815
 0.03       0.03333334 0.5933333  0.13703704 0.015      0.24444444
 0.64499998 0.04814815 0.02666667 0.02962963 0.65333331 0.13703704
 0.01833333 0.14814815 0.70666665 0.05185185 0.02666667 0.02962963
 0.71333331 0.13703704 0.01666667 0.14814815 0.76666665 0.05185185
 0.025      0.02962963 0.77499998 0.13703704 0.015      0.61851853
 0.82666665 0.04814815 0.02833333 0.03333334 0.83499998 0.13703704
 0.01666667 0.25555557 0.88833332 0.04814815 0.03       0.03333334
 0.89666665 0.13703704 0.02       0.24074075 0.95666665 0.18888889
 0.02666667 0.02592593 0.95833331 0.77037036 0.02666667 0.03333334
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.        ]


What should the Android do next?

Action: {"action_type": 3, "action_description": "Describe what the action means if needed", "coordinates_touch": [-1.0, -1.0], "coordinates_lift": [-1.0, -1.0], "text_input": ["amazon"]}