Episode ID: 8715627334930997253.935-1112.Add this item to cart
Step ID: 0
Goal: Add this item to cart

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' '' '' 'macbook' 'air' 'How are you shopping today?' '' 'A'
 'Same Day Delivery' 'Picking up' 'Shippa' 'Popular Filters' 'iPhone'
 'Apple' 'Electronio' 'Laptop' 'sloeves' 'casas' 'Bran' '' 'Category'
 'Price' 'Sald' 'by' '106 results for macbook air"'
 'Apple 45W MagSafe 2 Power' 'Adapter (for MacBook Air)' 'Apple' '' '' ''
 '' '' 't 75' 'S79.00' '"iten prshasal anlina' '' 'Add ta cart'
 'V7 Ellte CSESH-BLK-9N' 'Carrying Case (Sleeve) for...' 'VSevan' '$31.09'
 '"ihen cchASAcl onlna' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_SHOPPING_CART' 'ICON_PERSON' 'ICON_THREE_BARS'
 'ICON_MAGNIFYING_GLASS' 'TEXT' 'TEXT' 'TEXT' 'ICON_TAKE_PHOTO' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'ICON_V_FORWARD' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'ICON_STAR' 'ICON_STAR' 'ICON_STAR' 'ICON_STAR' 'ICON_STAR' 'TEXT'
 'TEXT' 'TEXT' 'ICON_HEART' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.04166667 0.89259261 0.03       0.03333334 0.04333333 0.77037036
 0.03       0.03333334 0.045      0.06666667 0.025      0.03333334
 0.045      0.64074075 0.02333333 0.02592593 0.05333333 0.21481481
 0.01166667 0.15185185 0.05333333 0.38148147 0.01166667 0.03333334
 0.105      0.04074074 0.01833333 0.61851853 0.14166667 0.38148147
 0.025      0.02962963 0.145      0.06666667 0.01833333 0.03333334
 0.145      0.37777779 0.02       0.38518518 0.14666666 0.12222222
 0.01833333 0.17777778 0.14833333 0.89629632 0.015      0.1037037
 0.22166666 0.04074074 0.01833333 0.30000001 0.30500001 0.11111111
 0.01333333 0.12962963 0.37333333 0.12592593 0.015      0.0962963
 0.37333333 0.8296296  0.01333333 0.15925926 0.375      0.49629629
 0.01333333 0.10740741 0.39833334 0.48518518 0.01166667 0.12222222
 0.40000001 0.87037039 0.01       0.09259259 0.44833332 0.8296296
 0.02       0.08888889 0.44833332 0.94074076 0.01833333 0.01851852
 0.45166665 0.21851853 0.01666667 0.14814815 0.45333335 0.45925927
 0.01166667 0.07777778 0.45333335 0.62962961 0.01166667 0.07037037
 0.45333335 0.71481484 0.01166667 0.03333334 0.50333333 0.04074074
 0.015      0.60370368 0.56666666 0.42592594 0.015      0.5
 0.58833331 0.42592594 0.01666667 0.45185184 0.61166668 0.42592594
 0.01166667 0.06666667 0.62333333 0.42592594 0.015      0.01481481
 0.62333333 0.45555556 0.01666667 0.01481481 0.62333333 0.48148149
 0.01666667 0.01851852 0.62333333 0.50740743 0.01666667 0.01481481
 0.62333333 0.53703701 0.01666667 0.01851852 0.62666667 0.54074073
 0.01333333 0.05925926 0.65166664 0.42592594 0.01333333 0.10740741
 0.68000001 0.42592594 0.00833333 0.29259259 0.80833334 0.8888889
 0.025      0.03333334 0.81833333 0.67407405 0.00833333 0.14814815
 0.87833333 0.42592594 0.01333333 0.41111112 0.90166664 0.42592594
 0.01666667 0.4925926  0.92500001 0.42592594 0.00833333 0.0962963
 0.94666666 0.42592594 0.01333333 0.10740741 0.97500002 0.42592594
 0.00833333 0.29259259 0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.8269770741462708, 0.7239302396774292], "coordinates_lift": [0.8269770741462708, 0.7239302396774292], "text_input": [""]}