Episode ID: 14860708898540864555.786-828.Add item to cart
Step ID: 0
Goal: Add item to cart

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'grcom' '' '' '' 'TODAYS' 'DEALS' '' 'Hello select address' '' ''
 '' '' '' 'BL' 'ADD TO CART' 'NO' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '']
UI Annotations Types: ['ICON_HOME' 'ICON_THREE_DOTS' 'TEXT' 'ICON_PERSON'
 'ICON_MAGNIFYING_GLASS' 'ICON_THREE_BARS' 'TEXT' 'TEXT' 'ICON_LOCATION'
 'TEXT' 'ICON_NOTIFICATIONS' 'ICON_CHAT' 'ICON_SHOPPING_CART' 'ICON_SHARE'
 'ICON_HEART' 'TEXT' 'TEXT' 'TEXT' 'ICON_V_BACKWARD' 'ICON_STOP' '' '' ''
 '' '' '' '' '' '' '' '' '' '']
Positions: [0.09153005 0.07038835 0.04644809 0.05097087 0.09153005 0.87621361
 0.04508197 0.02427184 0.10928962 0.35679612 0.02322404 0.22087379
 0.19125684 0.92233008 0.06284153 0.05825243 0.19262294 0.76456308
 0.05874317 0.05825243 0.19808744 0.05339806 0.05737705 0.06553398
 0.20491803 0.52912623 0.0204918  0.16262136 0.22404371 0.57766992
 0.0204918  0.1092233  0.29234973 0.04854369 0.04644809 0.04126213
 0.30191258 0.13106796 0.03688525 0.49757281 0.39344263 0.92961162
 0.04234973 0.04126213 0.5751366  0.83737862 0.05191257 0.05582524
 0.81010932 0.03640777 0.05054645 0.05825243 0.81420767 0.19417475
 0.05191257 0.05097087 0.81693989 0.342233   0.04371585 0.05339806
 0.81693989 0.94417477 0.0204918  0.0461165  0.83196723 0.51941746
 0.0204918  0.32766989 0.84562844 0.93203884 0.0204918  0.05582524
 0.92213112 0.22087379 0.04644809 0.04854369 0.92213112 0.71844661
 0.04644809 0.05339806 0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.8485501408576965, 0.6334270238876343], "coordinates_lift": [0.8485501408576965, 0.6334270238876343], "text_input": [""]}