Episode ID: 6641933136770436112.459-459.Go to search bar of chrome 
Step ID: 0
Goal: Go to search bar of chrome 

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' '' 'Google' '' 'Search or type web address' '' '' 'W' 'Facebook'
 'YouT ITube' 'Wikipedia' 'Amazon.co.' '' 'eb' 'YAHCO' 'ESPN.com' 'Yahoo'
 'eBay' 'Instagram' 'Articles for you' 'Hide' 'X' 'E'
 'Better stories from' 'Discover'
 "You'll see more stories about your interests."
 'Your activity here is saved in your Google'
 'You can turn off Discover in Chrome' 'Account.' 'at any time.' 'Walmart'
 'Closing Stores' 'Is' 'in' 'Welmals' 'These' 'LOcations, Starting' 'Now'
 'Walmart shoppers are now facing' 'both' 'temporary and'
 'permanent closures' 'as...' '' 'BL' 'Best Life - 9 hours' 'ago' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_PERSON' 'ICON_HOME' 'ICON_THREE_DOTS' 'TEXT' 'ICON_MIC' 'TEXT'
 'ICON_FACEBOOK' 'ICON_PLAY' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_TAKE_PHOTO' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_X' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT' 'ICON_V_BACKWARD'
 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.04017094 0.70555556 0.02905983 0.03333334 0.04358974 0.04074074
 0.02991453 0.03518518 0.04529915 0.9222222  0.02478633 0.01481481
 0.13247864 0.27962962 0.06666667 0.44259259 0.26495728 0.8888889
 0.03418804 0.02962963 0.27692309 0.06481481 0.01623932 0.47222221
 0.35726497 0.1388889  0.02905983 0.03703704 0.36495727 0.37222221
 0.01452991 0.01851852 0.36923078 0.82407409 0.01025641 0.03148148
 0.41111112 0.09814814 0.01111111 0.12407407 0.41111112 0.32962963
 0.01111111 0.11296296 0.41111112 0.77777779 0.01196581 0.12407407
 0.41196582 0.52962965 0.01025641 0.14814815 0.45213675 0.82037038
 0.02820513 0.03333334 0.45982906 0.57592595 0.00854701 0.03888889
 0.46410257 0.3611111  0.00598291 0.05       0.50427353 0.09259259
 0.01111111 0.13518518 0.50427353 0.34629631 0.01111111 0.08148148
 0.5051282  0.58333331 0.01196581 0.06111111 0.50598294 0.77592593
 0.01196581 0.12962963 0.55384618 0.07037037 0.01367521 0.19629629
 0.55470085 0.87222224 0.01025641 0.05740741 0.59914529 0.89814812
 0.01965812 0.02037037 0.6025641  0.07037037 0.01709402 0.04629629
 0.60341883 0.14629629 0.01452991 0.31666666 0.6042735  0.47777778
 0.01367521 0.14259259 0.63589746 0.14259259 0.01452991 0.64999998
 0.65897435 0.14259259 0.01452991 0.60925925 0.68119657 0.28518519
 0.01196581 0.53703701 0.6820513  0.14259259 0.01111111 0.12962963
 0.70427352 0.14444445 0.01452991 0.16481481 0.77777779 0.06851852
 0.01367521 0.14629629 0.77777779 0.26851851 0.01709402 0.24814814
 0.77863246 0.22962964 0.01282051 0.02407407 0.77863246 0.5314815
 0.01282051 0.02592593 0.79572648 0.80555558 0.02393162 0.11666667
 0.80512822 0.06851852 0.01367521 0.1037037  0.80512822 0.18703704
 0.01623932 0.32222223 0.80512822 0.52592593 0.01367521 0.07407407
 0.83418804 0.06851852 0.01538462 0.50740743 0.83418804 0.58888888
 0.01196581 0.06296296 0.85641026 0.06666667 0.01623932 0.21851853
 0.85641026 0.29814816 0.01538462 0.2962963  0.85982907 0.60740739
 0.00940171 0.05555556 0.88974357 0.90185183 0.02222222 0.01296296
 0.8940171  0.06666667 0.01538462 0.04074074 0.8957265  0.12777779
 0.01025641 0.24074075 0.89829057 0.38148147 0.01025641 0.04444445
 0.95811963 0.19629629 0.02649573 0.02777778 0.95811963 0.48148149
 0.02649573 0.03148148 0.95811963 0.77037036 0.02820513 0.03148148
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 10, "action_description": "Describe what the action means if needed", "coordinates_touch": [-1.0, -1.0], "coordinates_lift": [-1.0, -1.0], "text_input": [""]}