Episode ID: 12901419565517188755.776-942.Go to add
Step ID: 0
Goal: Go to add

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'a' 'energizer tri' '$89.,99' 'How do you want your items?' ''
 '95829' 'ETYI BaUTerTes (O PACKJ' 'ITTYU%' 'Triple A Alkaline.' '' '' ''
 '' '' '*t*tt 1560' 'Save with W+' 'Pickup' 'Delivery' '' '+Add' '500+'
 'bought since' 'Sponsored' '' 'Now $1798 S998' 'AAA24' 'Energ' '749 clea'
 'Energizer MAX AAA' '10' 'JBatteries (24 Pack),' 'Trinle A Alkalin' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_SHOPPING_CART' 'ICON_THREE_BARS' 'ICON_MAGNIFYING_GLASS' 'TEXT'
 'TEXT' 'TEXT' 'ICON_V_DOWNWARD' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_STAR'
 'ICON_STAR' 'ICON_STAR' 'ICON_STAR' 'ICON_STAR' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'ICON_PLUS' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_HEART' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_V_BACKWARD'
 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT' '' '' '' '' '' '' '' '' '' ''
 '' '' '']
Positions: [0.06967213 0.85436893 0.04371585 0.05339806 0.0806011  0.07038835
 0.04508197 0.05339806 0.08743169 0.71359223 0.03415301 0.03398058
 0.09562842 0.39805827 0.02459016 0.25728154 0.11885246 0.84466022
 0.01502732 0.0776699  0.19262294 0.04854369 0.0273224  0.65291262
 0.19262294 0.91504854 0.01912568 0.02669903 0.19535519 0.76941746
 0.01775956 0.11165048 0.23224044 0.37378642 0.02595628 0.47572815
 0.23770492 0.08980583 0.02322404 0.20873787 0.27185792 0.50485438
 0.0204918  0.30097088 0.31557378 0.50970876 0.02459016 0.02427184
 0.31557378 0.54368931 0.02322404 0.02184466 0.31557378 0.5825243
 0.02322404 0.02184466 0.31557378 0.61650485 0.02322404 0.02184466
 0.31557378 0.65533978 0.02322404 0.02427184 0.31967214 0.50485438
 0.01775956 0.26213592 0.36338797 0.50485438 0.01639344 0.21116506
 0.42076501 0.5169903  0.01639344 0.10194175 0.42076501 0.66262138
 0.01639344 0.12864077 0.48633879 0.64563107 0.03142076 0.0315534
 0.4931694  0.64563107 0.02322404 0.13106796 0.66393441 0.07524272
 0.0136612  0.08252427 0.66393441 0.1723301  0.01639344 0.2038835
 0.70218581 0.50485438 0.01639344 0.16504854 0.70901638 0.43446603
 0.02868852 0.03398058 0.73907101 0.50728154 0.02322404 0.33980581
 0.76229507 0.08737864 0.01639344 0.09951457 0.77595627 0.18932039
 0.0273224  0.10194175 0.77732241 0.50485438 0.0204918  0.13592233
 0.82377046 0.50728154 0.02595628 0.36893204 0.8306011  0.08737864
 0.01912568 0.02912621 0.85928965 0.47815534 0.0273224  0.3883495
 0.90163934 0.50242716 0.0204918  0.27184466 0.9385246  0.22572815
 0.03825137 0.03640777 0.9385246  0.47330096 0.03825137 0.04368932
 0.9385246  0.72330099 0.03825137 0.04368932 0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.5046543478965759, 0.7898170948028564], "coordinates_lift": [0.5046543478965759, 0.7898170948028564], "text_input": [""]}