Episode ID: 3472663207204160003.351-418.Go to ebay
Step ID: 0
Goal: Go to ebay

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' '' 'Google' '' 'Paste' '' 'Search or type web address' '' '' 'W'
 'YouTube' 'Wikipedia' 'Facebook' 'Amazon.C...' '' 'ebay' 'YAOO'
 'ESPN.com' 'Yahoo' 'eBay' 'Instagram' 'Articles for you' 'Hide' 'X'
 'Better stories from' 'Discover'
 "You'l see more stories about your interests."
 'Your activity here is saved' 'in your Google'
 'You can turn off Discover in Chrome' 'Account.' 'at any time.' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_HOME' 'ICON_PERSON' 'ICON_ARROW_UPWARD' 'TEXT' 'ICON_THREE_DOTS'
 'TEXT' 'ICON_MIC' 'TEXT' 'ICON_FACEBOOK' 'ICON_PLAY' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_TAKE_PHOTO' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_X' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.04459459 0.03888889 0.02905405 0.03333334 0.04527027 0.71805555
 0.02567567 0.02916667 0.04864865 0.9222222  0.01959459 0.02222222
 0.13851352 0.28333333 0.06554054 0.42777777 0.22499999 0.23888889
 0.02567567 0.01527778 0.2331081  0.07916667 0.01283784 0.08888889
 0.26959458 0.89444447 0.03175675 0.02916667 0.28175676 0.0625
 0.01824324 0.49861112 0.36418918 0.14166667 0.02905405 0.03472222
 0.37162161 0.37638888 0.01351351 0.01944445 0.37567568 0.82361114
 0.01013513 0.02638889 0.41824323 0.32916668 0.01216216 0.11805555
 0.41824323 0.77361113 0.01486486 0.13333334 0.41891891 0.09583333
 0.01148649 0.13055556 0.41959459 0.53472221 0.01081081 0.15694444
 0.46148649 0.82222223 0.02905405 0.03333334 0.47162163 0.58888888
 0.00945946 0.04722222 0.47432432 0.35833332 0.00743243 0.04027778
 0.51554054 0.08888889 0.01216216 0.14583333 0.51554054 0.34444445
 0.01148649 0.08611111 0.51621622 0.58194447 0.01418919 0.06388889
 0.51621622 0.77361113 0.01283784 0.13611111 0.56621623 0.06666667
 0.01621622 0.20833333 0.56689191 0.87222224 0.01216216 0.06111111
 0.61351353 0.90138888 0.01959459 0.01944445 0.61756754 0.12083333
 0.02094595 0.35416666 0.61959457 0.49166667 0.01486486 0.15416667
 0.65472972 0.1375     0.01689189 0.68194443 0.6797297  0.14027777
 0.01689189 0.40277779 0.6797297  0.55694443 0.01689189 0.22222222
 0.70472974 0.28749999 0.01351351 0.56527776 0.70540541 0.1388889
 0.01283784 0.13611111 0.73040539 0.1388889  0.01554054 0.17916666
 0.95743245 0.19166666 0.0277027  0.02916667 0.95810813 0.48194444
 0.02702703 0.02916667 0.95945948 0.77361113 0.025      0.02777778
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.4840604066848755, 0.5972355604171753], "coordinates_lift": [0.4840604066848755, 0.5972355604171753], "text_input": [""]}