Episode ID: 16059208899732570917.826-846.Go home
Step ID: 0
Goal: Go home

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'Route preview' '' '0.2 mi' 'left' 'Turn' 'etic' 'Parking Lot CP'
 'k' '' '' 'Permanente Creek Trail' 'Amphitheatre Pkwy' '' 'Googleple:'
 'Charleston' 'Park' 'Charleston Rd' '' 'Charleston Campus'
 "Zareen's Mountain View T" '101)' '' 'Bayshore Fwy' '<' '>' 'oring St'
 'Morga' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_THREE_DOTS' 'ICON_ARROW_BACKWARD' 'TEXT' 'ICON_UNDO' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_LOCATION' 'ICON_LOCATION' 'TEXT' 'TEXT'
 'ICON_LOCATION' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_LOCATION' 'TEXT' 'TEXT'
 'TEXT' 'ICON_QUESTION' 'TEXT' 'ICON_V_BACKWARD' 'ICON_V_FORWARD' 'TEXT'
 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.04444445 0.91296297 0.02649573 0.01666667 0.04529915 0.06296296
 0.02478633 0.02962963 0.05128205 0.36481482 0.01880342 0.27592593
 0.12307692 0.06666667 0.04273504 0.05740741 0.12478632 0.17592593
 0.01282051 0.09074074 0.15213676 0.26481482 0.01367521 0.05185185
 0.15299146 0.17592593 0.01282051 0.07407407 0.23846154 0.00185185
 0.01623932 0.04074074 0.24615385 0.60740739 0.01965812 0.24074075
 0.25897437 0.0037037  0.01111111 0.01481481 0.27521369 0.0037037
 0.03076923 0.02222222 0.29914531 0.17037037 0.04529915 0.03888889
 0.31367522 0.16851851 0.01880342 0.40000001 0.35384616 0.26666668
 0.02051282 0.27222222 0.38376069 0.37962964 0.03931624 0.03518518
 0.391453   0.18888889 0.02905983 0.17407407 0.40512821 0.50370371
 0.01538462 0.17407407 0.42136753 0.52962965 0.01623932 0.10555556
 0.47692308 0.21481481 0.01794872 0.19444445 0.55042738 0.61296296
 0.03931624 0.03518518 0.56410259 0.30925927 0.01794872 0.29259259
 0.72051281 0.44814816 0.01709402 0.38703704 0.75982904 0.23518519
 0.00940171 0.05740741 0.80341882 0.8759259  0.02820513 0.02962963
 0.88119656 0.56296295 0.05384615 0.19444445 0.88717949 0.77777779
 0.02222222 0.02037037 0.88717949 0.89999998 0.02222222 0.01851852
 0.8940171  0.46296296 0.02307692 0.07592592 0.9273504  0.39259258
 0.01452991 0.07592592 0.95726496 0.19074073 0.02820513 0.02777778
 0.95811963 0.48148149 0.02649573 0.03148148 0.95811963 0.77037036
 0.02820513 0.02962963 0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 6, "action_description": "Describe what the action means if needed", "coordinates_touch": [-1.0, -1.0], "coordinates_lift": [-1.0, -1.0], "text_input": [""]}