Episode ID: 16059208899732570917.699-718.Choose route taking 17 min
Step ID: 0
Goal: Choose route taking 17 min

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'Googleplex' '' '' 'Yi' 'Fang Taiwan' 'Fruit Tea' '' 'B' 'So'
 '15 min' '21 min' '51' 'min' '16 min' '16 min' 'View C'
 'Mountain View-Ace' 'Hardware of Mountain' 'Charleston Rd' '17 mir' ''
 'Villa' 'Santiagu' "e's" 'Bikes' 'alo' 'Alto' '' 'Microsoft Silicon'
 'Valley Campus' 'h01' 'A LOMA' '16 min' 'Jackinthe Box' '18 min'
 'JACKSON PARK' "Mancini's Sleepworld" '' '' 'Mountain View' '(2.7' 'mi)'
 '16 min' 'Mostly flat' '' '' '' 'Preview' 'Steps & more' '»' '' '' '' ''
 '' '']
UI Annotations Types: ['ICON_ARROW_BACKWARD' 'ICON_THREE_DOTS' 'TEXT' 'ICON_ARROW_UPWARD'
 'ICON_LOCATION' 'TEXT' 'TEXT' 'TEXT' 'ICON_ARROW_DOWNWARD'
 'ICON_SAD_FACE' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_MAGNIFYING_GLASS' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_LOCATION' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_LOCATION' 'ICON_QUESTION' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_LIST' 'ICON_V_FORWARD' 'ICON_V_FORWARD' 'TEXT'
 'TEXT' 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT'
 '' '' '']
Positions: [0.04529915 0.05185185 0.02393162 0.02777778 0.04529915 0.92407405
 0.02478633 0.01481481 0.05128205 0.22777778 0.01709402 0.18888889
 0.0974359  0.91296297 0.01880342 0.01666667 0.0991453  0.14074074
 0.02307692 0.02222222 0.10683761 0.22777778 0.01282051 0.02777778
 0.10683761 0.27037036 0.01623932 0.21296297 0.10683761 0.49814814
 0.01282051 0.14259259 0.10683761 0.93148148 0.01709402 0.01481481
 0.15384616 0.17222223 0.02222222 0.02407407 0.15982907 0.81111109
 0.01538462 0.04444445 0.16068377 0.00740741 0.01196581 0.09814814
 0.16068377 0.22407408 0.01196581 0.0962963  0.16068377 0.44074073
 0.01196581 0.02777778 0.16068377 0.48148149 0.01196581 0.05
 0.16068377 0.65555555 0.01196581 0.0962963  0.16068377 0.87222224
 0.01282051 0.0962963  0.1974359  0.90185183 0.01111111 0.09444445
 0.21111111 0.00555556 0.01452991 0.30185184 0.22905983 0.02407407
 0.01538462 0.32777777 0.24188034 0.42037037 0.01111111 0.1574074
 0.26752138 0.77222222 0.01282051 0.11481482 0.27863249 0.89444447
 0.02649573 0.03333334 0.31196582 0.93518519 0.01196581 0.05555556
 0.31282052 0.79444444 0.01452991 0.12962963 0.31452993 0.00185185
 0.01196581 0.02777778 0.31452993 0.04444445 0.01111111 0.07222223
 0.33247864 0.0037037  0.01196581 0.04259259 0.33247864 0.05555556
 0.01196581 0.05740741 0.3923077  0.94629627 0.03675214 0.03333334
 0.3974359  0.67962962 0.01623932 0.25185186 0.41623932 0.70555556
 0.01709402 0.22962964 0.45213675 0.82592595 0.01367521 0.06296296
 0.47008547 0.00925926 0.01025641 0.0962963  0.49059829 0.40185186
 0.01367521 0.11296296 0.59743589 0.44074073 0.01538462 0.23333333
 0.65811968 0.10555556 0.01282051 0.11481482 0.68119657 0.57407409
 0.01538462 0.22592592 0.72222221 0.01296296 0.01452991 0.30740741
 0.72820514 0.70185184 0.04786325 0.04074074 0.73162395 0.8759259
 0.02820513 0.02962963 0.74102563 0.01296296 0.01111111 0.21851853
 0.82051283 0.21481481 0.02222222 0.08148148 0.82051283 0.31481481
 0.02222222 0.06851852 0.8213675  0.04259259 0.01880342 0.14444445
 0.85811967 0.04259259 0.01794872 0.17777778 0.90341878 0.35740742
 0.02051282 0.02407407 0.90427351 0.07222223 0.01709402 0.01296296
 0.90512818 0.09074074 0.01538462 0.01111111 0.90683758 0.1388889
 0.01282051 0.12037037 0.90769231 0.41666666 0.01538462 0.20185184
 0.90854698 0.07777778 0.01111111 0.02777778 0.95811963 0.19629629
 0.02649573 0.02777778 0.95897436 0.48148149 0.02564103 0.03148148
 0.95897436 0.77037036 0.02564103 0.02962963 0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.5012433528900146, 0.7326886653900146], "coordinates_lift": [0.5012433528900146, 0.7326886653900146], "text_input": [""]}