Episode ID: 7720719665755884489.1317-1317.Add to cart the selected result.
Step ID: 0
Goal: Add to cart the selected result.

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' '' 'Search everythin' 'Q' '$1159,96' ''
 'How do you want your items?' '|' '95829' 'Stone Blue' 'White Smoke'
 'Black' '$149.00' '$149.00' '$149.00' 'a' 'by today to' 'Free'
 'shipping,' 'arrives' 'Sacramento, 95829' 'Add an address to see options'
 'Want it faster?' 'Pickup' 'not available at Sacramento Supercenter'
 'Check availability nearby.' '*' 'Sold and shipped by Walmart.com' 'O'
 'Free Holiday returns until Jan 31' 'Details' 'is gift eligible'
 'Learn more' 'This' 'item' 'O' 'm' 'Add to registry.' 'Add to list'
 'Protect your purchase' 'V' '$149.00' 'Add to cart' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_SHOPPING_CART' 'ICON_THREE_BARS' 'ICON_MAGNIFYING_GLASS' 'TEXT'
 'TEXT' 'TEXT' 'ICON_V_DOWNWARD' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_HEART' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_V_DOWNWARD' 'TEXT' 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_CIRCLE'
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.05       0.86481482 0.03421053 0.04814815 0.0622807  0.06481481
 0.03157895 0.04444445 0.06491228 0.73888886 0.0254386  0.02962963
 0.07017544 0.35740742 0.02017544 0.31851852 0.07017544 0.71111113
 0.02017544 0.06666667 0.09035087 0.84629631 0.01140351 0.09814814
 0.14385965 0.91851854 0.01666667 0.02407407 0.14473684 0.04444445
 0.02017544 0.59074074 0.14649123 0.66296297 0.01754386 0.00185185
 0.14736842 0.69074076 0.01315789 0.1037037  0.26491228 0.39444444
 0.01403509 0.17407407 0.26491228 0.70925927 0.01403509 0.21666667
 0.26666668 0.07407407 0.01491228 0.08888889 0.29649124 0.39259258
 0.01929825 0.14629629 0.29649124 0.70925927 0.01929825 0.14629629
 0.29912281 0.07407407 0.01842105 0.14444445 0.3859649  0.04814815
 0.01403509 0.03703704 0.3868421  0.50185186 0.01842105 0.18518518
 0.3877193  0.13703704 0.0122807  0.07037037 0.3877193  0.22037037
 0.01666667 0.14444445 0.3877193  0.37777779 0.01315789 0.11111111
 0.41491228 0.13333334 0.01666667 0.32777777 0.44561404 0.38703704
 0.02017544 0.49814814 0.44736841 0.13518518 0.01403509 0.2462963
 0.49649122 0.13703704 0.01754386 0.10555556 0.49649122 0.2574074
 0.01754386 0.67962962 0.5219298  0.12407407 0.01929825 0.42407408
 0.56666666 0.05       0.01842105 0.03333334 0.56929827 0.11296296
 0.01754386 0.55740738 0.61666667 0.04629629 0.01666667 0.04074074
 0.61842108 0.13703704 0.01754386 0.53333336 0.61842108 0.69444442
 0.01666667 0.11296296 0.69035089 0.29259259 0.01929825 0.22777778
 0.69035089 0.55925924 0.02105263 0.19444445 0.69122809 0.12962963
 0.01403509 0.06481481 0.69122809 0.2074074  0.01403509 0.07222223
 0.73596489 0.05       0.02105263 0.02777778 0.7377193  0.4537037
 0.02017544 0.03148148 0.7385965  0.52407408 0.02280702 0.26666668
 0.7394737  0.12962963 0.02017544 0.17407407 0.81228071 0.09259259
 0.02017544 0.42222223 0.81842107 0.85925925 0.02017544 0.03518518
 0.87807018 0.04629629 0.02105263 0.16296296 0.88245612 0.6703704
 0.01491228 0.21666667 0.95175439 0.22962964 0.02982456 0.03148148
 0.95175439 0.47962964 0.02982456 0.03518518 0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.        ]


What should the Android do next?

Action: {"action_type": 10, "action_description": "Describe what the action means if needed", "coordinates_touch": [-1.0, -1.0], "coordinates_lift": [-1.0, -1.0], "text_input": [""]}