Episode ID: 8464958840266364706.127-298.Open the search bar on google and go to ebay
Step ID: 0
Goal: Open the search bar on google and go to ebay

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'P' 'Google' '' 'Search or type web address' '' '' 'W' 'Wikipedia'
 'Facebook' 'YouTube' 'Amazon.com' '' 'ebay' 'YAHOO' 'ESPN.com' 'Yahoo'
 'eBay' 'Instagram' '' 'Discover' 'Better stories from Discover' "You'll"
 'see more stories' 'about your interests.' 'Your' 'activity' 'here' 'is'
 'saved' 'in' 'Google' 'your' 'off Discover in' 'Account.' 'You can turn'
 'Chrome at any time.' 'Best Buy releases new round' 'of early' 'Black'
 'Friday' 'deals' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_HOME' 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'ICON_MIC' 'TEXT'
 'ICON_FACEBOOK' 'ICON_PLAY' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_TAKE_PHOTO' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_SETTINGS' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_CIRCLE'
 'ICON_NAV_BAR_RECT' '' '' '' '' '' '' '' '']
Positions: [0.04700855 0.04444445 0.03162393 0.03703704 0.04786325 0.91296297
 0.03076923 0.01851852 0.04957265 0.6722222  0.02307692 0.03333334
 0.14957266 0.25555557 0.07179487 0.48518518 0.291453   0.86666667
 0.03333334 0.02962963 0.30341882 0.08148148 0.01538462 0.4611111
 0.3897436  0.14259259 0.03418804 0.03888889 0.40000001 0.37777779
 0.01452991 0.01851852 0.40341881 0.82222223 0.01196581 0.03148148
 0.44786325 0.77777779 0.01367521 0.12407407 0.44871795 0.10185185
 0.01196581 0.12037037 0.44871795 0.33333334 0.01025641 0.10925926
 0.44957265 0.52962965 0.00940171 0.16851851 0.49230769 0.82037038
 0.02905983 0.03518518 0.50256413 0.58518517 0.00940171 0.05555556
 0.50598294 0.36296296 0.00512821 0.03518518 0.54871798 0.0962963
 0.01025641 0.13333334 0.54957265 0.34814814 0.01025641 0.07962963
 0.54957265 0.58333331 0.01196581 0.06111111 0.54957265 0.77777779
 0.01196581 0.12592593 0.59743589 0.91666669 0.02649573 0.02962963
 0.60512823 0.04444445 0.01282051 0.13333334 0.68888891 0.16296296
 0.02051282 0.55740738 0.72307694 0.18518518 0.01196581 0.07592592
 0.72307694 0.27407408 0.01196581 0.24444444 0.72307694 0.5314815
 0.01452991 0.30000001 0.74700856 0.18518518 0.01111111 0.06666667
 0.74700856 0.26296297 0.01452991 0.1037037  0.74700856 0.37777779
 0.01111111 0.06111111 0.74700856 0.45185184 0.01111111 0.02037037
 0.74700856 0.48518518 0.01111111 0.08333334 0.74700856 0.58148146
 0.01111111 0.02222222 0.74700856 0.68888891 0.01452991 0.1037037
 0.74957263 0.61481482 0.01196581 0.06296296 0.77008545 0.52407408
 0.01196581 0.21111111 0.77094018 0.18518518 0.01111111 0.12962963
 0.77094018 0.32777777 0.01111111 0.18333334 0.79401708 0.18703704
 0.01367521 0.28703704 0.88119656 0.04629629 0.01880342 0.55000001
 0.90854698 0.04444445 0.01965812 0.14074074 0.90854698 0.2
 0.01538462 0.10185185 0.90854698 0.31851852 0.01965812 0.11296296
 0.90854698 0.4462963  0.01538462 0.1        0.95641023 0.19629629
 0.02905983 0.02962963 0.95641023 0.47962964 0.02820513 0.03333334
 0.95641023 0.76851851 0.02905983 0.03148148 0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.31329476833343506, 0.5731378793716431], "coordinates_lift": [0.31329476833343506, 0.5731378793716431], "text_input": [""]}