Episode ID: 2384152719947582948.213-213.Click on the shortcut of amazon on google chrome.
Step ID: 0
Goal: Click on the shortcut of amazon on google chrome.

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'U' 'Google' '' 'Search or type web address' '' '' 'W'
 'Walmart.com ..' 'Facebook' 'YouTube' 'Amazon.com' 'ebay' 'YAHOC'
 'ESPN.com' 'Yahoo' 'Wikipedia' 'eBay' '' 'Discover' 'Jury awards $21'
 'million to' 'in' 'man' 'after leg' 'vegetative' 'state' 'surgery at'
 'ott &e' 'YMEDeaL' 'Dallas' 'hospital' '' 'Dallas Morning News' '12h'
 'Better stories from Discover' 'E1' "You'll" 'stories' 'about your'
 'interests.' 'Your activity' 'see' 'more' 'here is saved'
 'in your Google Account.' 'You can turn off' 'Discover' 'Chrome'
 'any time.' 'in' 'at' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_HOME' 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'ICON_MIC' 'TEXT'
 'ICON_FACEBOOK' 'ICON_PLAY' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_SETTINGS' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT' 'ICON_V_BACKWARD' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '']
Positions: [0.04662162 0.04027778 0.0277027  0.03333334 0.04662162 0.9236111
 0.0277027  0.01527778 0.04932432 0.70555556 0.01756757 0.02777778
 0.14391892 0.27638888 0.06891892 0.43888888 0.28243244 0.87777776
 0.03108108 0.02777778 0.29391891 0.07361111 0.01283784 0.38055557
 0.37635136 0.36805555 0.03175675 0.03888889 0.38445947 0.60138887
 0.01554054 0.01805556 0.38851351 0.15416667 0.01013513 0.02222222
 0.43310812 0.08194444 0.01013513 0.15694444 0.43310812 0.33888888
 0.01013513 0.1        0.43310812 0.56805557 0.00878378 0.08888889
 0.43378377 0.76666665 0.00878378 0.1388889  0.48378378 0.80972224
 0.00878378 0.05138889 0.48648649 0.58888888 0.00540541 0.03611111
 0.52702701 0.33472222 0.01081081 0.10972222 0.52770269 0.58055556
 0.00945946 0.0625     0.52837837 0.11527777 0.01081081 0.09861111
 0.52837837 0.8125     0.01081081 0.05       0.57432431 0.9236111
 0.02364865 0.02777778 0.58175677 0.04027778 0.01081081 0.10972222
 0.63918918 0.04027778 0.01689189 0.24722221 0.63986486 0.30555555
 0.01283784 0.1375     0.64054054 0.53333336 0.01216216 0.02222222
 0.64391893 0.45555556 0.00878378 0.06388889 0.66283786 0.29305556
 0.01621622 0.12222222 0.66351354 0.04027778 0.01554054 0.15416667
 0.66418916 0.20694445 0.01148649 0.07361111 0.66418916 0.42777777
 0.01486486 0.15000001 0.67297298 0.71249998 0.00878378 0.04583333
 0.68513513 0.71388888 0.00540541 0.06527778 0.6858108  0.04166667
 0.01283784 0.09027778 0.6858108  0.14444445 0.01621622 0.11944444
 0.73648649 0.93333334 0.02162162 0.01388889 0.74459457 0.09861111
 0.01081081 0.22083333 0.74459457 0.34027779 0.00878378 0.03611111
 0.82837838 0.17083333 0.01351351 0.42777777 0.82905406 0.09027778
 0.01554054 0.04861111 0.86013514 0.16805555 0.01013513 0.06111111
 0.86013514 0.35833332 0.01013513 0.07916667 0.86013514 0.44722223
 0.01216216 0.12638889 0.86013514 0.58333331 0.01013513 0.10833333
 0.86013514 0.69999999 0.01216216 0.14305556 0.86283785 0.23888889
 0.00743243 0.04166667 0.86283785 0.29027778 0.00743243 0.05833333
 0.88040543 0.16944444 0.01013513 0.15416667 0.88040543 0.33472222
 0.01283784 0.28333333 0.88040543 0.62638891 0.01013513 0.19305556
 0.90067565 0.17083333 0.01013513 0.1        0.90067565 0.30833334
 0.01013513 0.09166667 0.90067565 0.44027779 0.01283784 0.10694444
 0.90135133 0.28055555 0.00945946 0.01805556 0.90202701 0.40972221
 0.00878378 0.02083333 0.95675677 0.48472223 0.0277027  0.03055556
 0.95675677 0.77222222 0.02702703 0.02916667 0.95743245 0.19583334
 0.02567567 0.02638889 0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.        ]


What should the Android do next?

Action: {"action_type": 10, "action_description": "Describe what the action means if needed", "coordinates_touch": [-1.0, -1.0], "coordinates_lift": [-1.0, -1.0], "text_input": [""]}