Episode ID: 17585541886958895731.1069-1106.add to cart
Step ID: 0
Goal: add to cart

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' '' 'panasonic' 'triple' 'a' '$O.00' ''
 'How do you want your items?' '|' '95829' '3+ day shipping' '' '+Add'
 'AA' '' 'Pana' '$10.17' 'Panasonic' '24pc Panasonic AAA' 'ni'
 'Batteries Super Heavy' 'Duty Power Carbon Zinc...' '' '' '' '' ''
 '*t***' 'Share' 'Select all' 'Web search' 'Copy' '' 'Add' 'X' 'Shopping'
 'Walmart' '& Grocery' '-' 'The easiest way to shop, check out & track'
 'your orders - anywhere you are.' '' '' '' '' '' '*tttt' 'Get the app' ''
 '' '']
UI Annotations Types: ['ICON_SHOPPING_CART' 'ICON_THREE_BARS' 'ICON_MAGNIFYING_GLASS' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_V_DOWNWARD' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_PLUS' 'TEXT' 'TEXT' 'ICON_HEART' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_STAR' 'ICON_STAR' 'ICON_STAR' 'ICON_STAR' 'ICON_STAR'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_PLUS' 'TEXT' 'ICON_X' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_STAR' 'ICON_STAR' 'ICON_STAR'
 'ICON_STAR' 'ICON_STAR' 'TEXT' 'TEXT' 'ICON_NAV_BAR_RECT'
 'ICON_NAV_BAR_CIRCLE' 'ICON_V_BACKWARD']
Positions: [0.04912281 0.87222224 0.03508772 0.04074074 0.05877193 0.06111111
 0.03333334 0.04814815 0.06315789 0.75       0.02368421 0.02962963
 0.06842105 0.34444445 0.01842105 0.17592593 0.06842105 0.53333336
 0.01842105 0.0962963  0.07368421 0.64259261 0.00964912 0.01481481
 0.08596491 0.86851853 0.01140351 0.06111111 0.13859649 0.92407405
 0.01491228 0.02222222 0.13947369 0.09444445 0.01666667 0.51296294
 0.14035088 0.63518518 0.01578947 0.00185185 0.14122806 0.66111112
 0.0122807  0.1        0.17192982 0.49629629 0.0122807  0.22592592
 0.21842106 0.6574074  0.02719298 0.02777778 0.22456141 0.65555555
 0.01666667 0.11481482 0.36842105 0.09814814 0.01754386 0.05555556
 0.3745614  0.43148148 0.02192982 0.02592593 0.3754386  0.37592593
 0.01315789 0.04259259 0.37719297 0.50185186 0.01754386 0.10185185
 0.39035088 0.12037037 0.01403509 0.17407407 0.42017543 0.50185186
 0.01578947 0.32777777 0.44561404 0.43148148 0.01578947 0.04259259
 0.44824561 0.50370371 0.01578947 0.35370371 0.4763158  0.50370371
 0.01491228 0.4074074  0.50438595 0.53518516 0.02017544 0.02037037
 0.50526315 0.50370371 0.01842105 0.02037037 0.50526315 0.56851852
 0.01842105 0.01851852 0.50526315 0.60000002 0.01842105 0.01851852
 0.50526315 0.63148147 0.02017544 0.02222222 0.5096491  0.50740743
 0.01315789 0.15000001 0.55350876 0.35740742 0.01315789 0.09259259
 0.55350876 0.51111114 0.01315789 0.14629629 0.55350876 0.72037035
 0.01315789 0.19074073 0.55438596 0.21296297 0.01666667 0.08148148
 0.59736842 0.6574074  0.0254386  0.02777778 0.60614038 0.70740741
 0.01315789 0.06296296 0.71666664 0.9074074  0.02894737 0.03333334
 0.72105265 0.34814814 0.01491228 0.12407407 0.72192985 0.2037037
 0.01052632 0.11296296 0.72192985 0.48518518 0.01315789 0.1388889
 0.7280702  0.32962963 0.00175439 0.00555556 0.75350875 0.2037037
 0.01666667 0.67777777 0.77807015 0.2037037  0.01666667 0.51296294
 0.81052631 0.23888889 0.01754386 0.01666667 0.81052631 0.27222222
 0.01754386 0.01666667 0.81052631 0.3037037  0.01842105 0.01666667
 0.81140351 0.20555556 0.01754386 0.01851852 0.81140351 0.33703703
 0.01754386 0.01666667 0.81403506 0.2037037  0.01315789 0.15555556
 0.88245612 0.39259258 0.01929825 0.21666667 0.95263159 0.76666665
 0.02982456 0.03518518 0.95438594 0.47962964 0.02894737 0.03333334
 0.95526314 0.19629629 0.02807018 0.02962963]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.6054417490959167, 0.7490974068641663], "coordinates_lift": [0.6054417490959167, 0.7490974068641663], "text_input": [""]}