Episode ID: 3472663207204160003.351-418.Open ebay
Step ID: 0
Goal: Open ebay

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' '' 'Google' '' 'Paste' '' 'Search or type web address' '' '' 'W'
 'YouTube' 'Wikipedia' 'Facebook' 'Amazon.C...' '' 'ebay' 'YAOO'
 'ESPN.com' 'Yahoo' 'eBay' 'Instagram' 'Articles for you' 'Hide' 'X'
 'Better stories from' 'Discover'
 "You'l see more stories about your interests."
 'Your activity here is saved' 'in your Google'
 'You can turn off Discover in Chrome' 'Account.' 'at any time.' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_HOME' 'ICON_PERSON' 'ICON_ARROW_UPWARD' 'TEXT' 'ICON_THREE_DOTS'
 'TEXT' 'ICON_MIC' 'TEXT' 'ICON_FACEBOOK' 'ICON_PLAY' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_TAKE_PHOTO' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_X' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT' '' ''
 '' '' '' '' '' '' '' '' '' '']
Positions: [0.04459459 0.03888889 0.02905405 0.03333334 0.04527027 0.71805555
 0.02567567 0.02916667 0.04864865 0.9222222  0.01959459 0.02222222
 0.13851352 0.28333333 0.06554054 0.42777777 0.22499999 0.23888889
 0.02567567 0.01527778 0.2331081  0.07916667 0.01283784 0.08888889
 0.26959458 0.89444447 0.03175675 0.02916667 0.28175676 0.0625
 0.01824324 0.49861112 0.36418918 0.14166667 0.02905405 0.03472222
 0.37162161 0.37638888 0.01351351 0.01944445 0.37567568 0.82361114
 0.01013513 0.02638889 0.41824323 0.32916668 0.01216216 0.11805555
 0.41824323 0.77361113 0.01486486 0.13333334 0.41891891 0.09583333
 0.01148649 0.13055556 0.41959459 0.53472221 0.01081081 0.15694444
 0.46148649 0.82222223 0.02905405 0.03333334 0.47162163 0.58888888
 0.00945946 0.04722222 0.47432432 0.35833332 0.00743243 0.04027778
 0.51554054 0.08888889 0.01216216 0.14583333 0.51554054 0.34444445
 0.01148649 0.08611111 0.51621622 0.58194447 0.01418919 0.06388889
 0.51621622 0.77361113 0.01283784 0.13611111 0.56621623 0.06666667
 0.01621622 0.20833333 0.56689191 0.87222224 0.01216216 0.06111111
 0.61351353 0.90138888 0.01959459 0.01944445 0.61756754 0.12083333
 0.02094595 0.35416666 0.61959457 0.49166667 0.01486486 0.15416667
 0.65472972 0.1375     0.01689189 0.68194443 0.6797297  0.14027777
 0.01689189 0.40277779 0.6797297  0.55694443 0.01689189 0.22222222
 0.70472974 0.28749999 0.01351351 0.56527776 0.70540541 0.1388889
 0.01283784 0.13611111 0.73040539 0.1388889  0.01554054 0.17916666
 0.95743245 0.19166666 0.0277027  0.02916667 0.95810813 0.48194444
 0.02702703 0.02916667 0.95945948 0.77361113 0.025      0.02777778
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.4840604066848755, 0.5972355604171753], "coordinates_lift": [0.4840604066848755, 0.5972355604171753], "text_input": [""]}