Episode ID: 16059208899732570917.749-776.Next
Step ID: 0
Goal: Next

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'Route preview' '' 'Head north' 'Shoreline Amphitheatre'
 'gle Athletic' 'Parking Lot CP' 'Field Park..' '' ''
 'Permanente Creek Trail' 'mphitheatre Pkwy' '' 'Googleplex' 'Charleston'
 'Park' 'Charleston Rd' '' 'Charleston Campus' 'yshore Fwy' '' '' ''
 "Zareen's" 'Mc' '01' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_THREE_DOTS' 'ICON_ARROW_BACKWARD' 'TEXT' 'ICON_ARROW_UPWARD' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_LOCATION' 'ICON_LOCATION' 'TEXT' 'TEXT'
 'ICON_LOCATION' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_LOCATION' 'TEXT' 'TEXT'
 'ICON_QUESTION' 'ICON_V_BACKWARD' 'ICON_V_FORWARD' 'TEXT' 'TEXT' 'TEXT'
 'ICON_V_BACKWARD' 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.04444445 0.91296297 0.02649573 0.01666667 0.04529915 0.06296296
 0.02478633 0.02962963 0.05128205 0.36481482 0.01880342 0.27407408
 0.12222222 0.06851852 0.03589744 0.04074074 0.13846155 0.17777778
 0.01367521 0.18703704 0.29914531 0.44999999 0.01880342 0.34814814
 0.40683761 0.00185185 0.01623932 0.15185185 0.41452992 0.71481484
 0.01965812 0.25370371 0.42564103 0.00185185 0.01538462 0.13518518
 0.44017094 0.1        0.03931624 0.03703704 0.46581197 0.27777779
 0.04700855 0.04074074 0.48376068 0.32407406 0.01282051 0.35185185
 0.52393162 0.39814815 0.01794872 0.24814814 0.55213678 0.48703703
 0.03589744 0.03333334 0.56666666 0.30740741 0.01452991 0.16481481
 0.57350427 0.59814817 0.01538462 0.18703704 0.58803421 0.64814812
 0.01709402 0.09259259 0.64529914 0.32222223 0.01709402 0.19444445
 0.71880341 0.7185185  0.04017094 0.03703704 0.73162395 0.41666666
 0.01709402 0.29259259 0.782906   0.02407407 0.05042735 0.14259259
 0.80427349 0.8759259  0.02991453 0.03148148 0.88461536 0.78333336
 0.02649573 0.02037037 0.88717949 0.90185183 0.02222222 0.01851852
 0.88974357 0.55555558 0.01282051 0.12037037 0.8905983  0.68888891
 0.01196581 0.04074074 0.92991453 0.35740742 0.00940171 0.03333334
 0.95726496 0.19074073 0.02820513 0.02777778 0.95811963 0.48148149
 0.02820513 0.03148148 0.95811963 0.77037036 0.02649573 0.03148148
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.8975890278816223, 0.915015459060669], "coordinates_lift": [0.8975890278816223, 0.915015459060669], "text_input": [""]}