Episode ID: 15867775413853004177.225-272.Go to ebay.com
Step ID: 0
Goal: Go to ebay.com

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'Google' '' 'Search or type web address' '' 'a' '' 'W' 'YouTube'
 'Wikipedia' 'Facebook' 'Amazon...' '' 'eby' 'YAHOOH' 'ESPN.com' 'Yahoo'
 'eBay' 'Instagram' 'Articles' 'Hide' 'for you' 'CMA Awards 2016:'
 'Alan Jackson Walks' 'Middle Of' 'In The' 'Out' 'Alan Jackson'
 'has never' 'been' 'afraid to' 'make' 'st...' 'a' '' '*' 'Whiskey'
 'Riff - 2' 'days ago' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_HOME' 'ICON_THREE_DOTS' 'TEXT' 'ICON_MIC' 'TEXT' 'ICON_FACEBOOK'
 'TEXT' 'ICON_PLAY' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_TAKE_PHOTO'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT' 'ICON_V_BACKWARD' '' '' '' ''
 '' '' '']
Positions: [0.05128205 0.04629629 0.02991453 0.03703704 0.05128205 0.91296297
 0.02820513 0.01666667 0.16068377 0.24074075 0.07521368 0.50740743
 0.30512822 0.8759259  0.03504274 0.03333334 0.31538463 0.07407407
 0.02393162 0.6574074  0.40683761 0.12037037 0.03675214 0.04444445
 0.41452992 0.60185188 0.01965812 0.04074074 0.41709402 0.36851853
 0.01709402 0.02222222 0.42222223 0.83703703 0.01282051 0.02962963
 0.47008547 0.3037037  0.01538462 0.15555556 0.47008547 0.77222222
 0.01880342 0.16666667 0.47094017 0.06111111 0.01452991 0.16851851
 0.47179487 0.52777779 0.01452991 0.17962962 0.52136755 0.83518517
 0.02905983 0.03703704 0.53162396 0.58888888 0.01111111 0.05740741
 0.53418803 0.35370371 0.00598291 0.05185185 0.58119661 0.0537037
 0.01452991 0.18518518 0.58119661 0.32777777 0.01538462 0.10925926
 0.58205128 0.5777778  0.01623932 0.07592592 0.58205128 0.76851851
 0.01623932 0.17407407 0.63931626 0.08148148 0.01452991 0.12962963
 0.64017093 0.84444445 0.01452991 0.07592592 0.64102566 0.22407408
 0.01623932 0.12222222 0.70170939 0.08148148 0.01880342 0.4462963
 0.73846155 0.07962963 0.01880342 0.47222221 0.77435899 0.33888888
 0.01965812 0.22592592 0.77521366 0.17962962 0.01880342 0.1388889
 0.77606839 0.08148148 0.01794872 0.07777778 0.81538463 0.07777778
 0.01623932 0.27962962 0.81538463 0.37592593 0.01623932 0.19444445
 0.84700853 0.08148148 0.01538462 0.0962963  0.84700853 0.19444445
 0.01538462 0.16851851 0.84700853 0.37962964 0.01538462 0.10925926
 0.84871793 0.54259259 0.01367521 0.06481481 0.85128206 0.50555557
 0.01111111 0.02037037 0.8888889  0.8888889  0.02393162 0.01481481
 0.8923077  0.08518519 0.01794872 0.03148148 0.8923077  0.14629629
 0.01880342 0.15000001 0.89316237 0.31296295 0.01452991 0.11851852
 0.89316237 0.44814816 0.01794872 0.16111112 0.95299143 0.47962964
 0.02905983 0.03333334 0.95299143 0.72777778 0.03162393 0.03703704
 0.95470083 0.22962964 0.02905983 0.03148148 0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.5427550077438354, 0.6234853267669678], "coordinates_lift": [0.5427550077438354, 0.6234853267669678], "text_input": [""]}