Episode ID: 5302989314060764843.208-337.Go to bestbuy cart
Step ID: 0
Goal: Go to bestbuy cart

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'bestbuy.com' '' 'Your Store:' 'Bangor' '' '' 'BEST' '' 'BUY'
 'Search' 'Black' 'Friday' 'Deals' 'Right' 'Now' 'Top' 'Deals' 'Deal'
 'of the' 'Day' 'Black Friday' 'Deals' 'with' 'Black' 'Friday' 'Start'
 'saving' 'prices' 'today.' 'See Black Friday FAQs' 'Limited'
 'quantities.' 'No' 'rainchecks.' 'Shop the Deals' 'tol UD' 'Laptops &'
 'TVs &' 'Apple' 'Computers' 'Projectors' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_HOME' 'ICON_THREE_DOTS' 'TEXT' 'ICON_V_DOWNWARD' 'TEXT' 'TEXT'
 'ICON_SHOPPING_CART' 'ICON_THREE_BARS' 'TEXT' 'ICON_MAGNIFYING_GLASS'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT'
 'ICON_V_BACKWARD' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.05       0.04629629 0.03070175 0.03518518 0.05       0.91481483
 0.02894737 0.01666667 0.05701754 0.24259259 0.01842105 0.23703703
 0.11666667 0.92777777 0.01842105 0.02777778 0.12017544 0.04074074
 0.01140351 0.17407407 0.12017544 0.22592592 0.01491228 0.11666667
 0.15789473 0.88703704 0.05438596 0.06481481 0.16754386 0.25925925
 0.03596491 0.05       0.17017543 0.04629629 0.01842105 0.12592593
 0.1745614  0.76666665 0.02719298 0.03703704 0.18333334 0.04629629
 0.03333334 0.14074074 0.18333334 0.4148148  0.01315789 0.10740741
 0.24912281 0.04629629 0.01140351 0.07962963 0.24912281 0.14074074
 0.01491228 0.09259259 0.24912281 0.2462963  0.01140351 0.08333334
 0.24912281 0.34444445 0.01491228 0.07962963 0.24912281 0.43703705
 0.01140351 0.06481481 0.24912281 0.56111109 0.01491228 0.05555556
 0.24912281 0.63148147 0.01140351 0.08333334 0.24912281 0.77222222
 0.01140351 0.06481481 0.24912281 0.85000002 0.01140351 0.09074074
 0.24912281 0.95555556 0.01140351 0.03703704 0.31403509 0.05185185
 0.05789474 0.76296294 0.36842105 0.05185185 0.04736842 0.34444445
 0.48421052 0.35185185 0.01929825 0.1        0.48421052 0.47407407
 0.01929825 0.12592593 0.48421052 0.62037039 0.02368421 0.14444445
 0.48508772 0.04629629 0.01842105 0.11481482 0.48508772 0.17962962
 0.02280702 0.15185185 0.48508772 0.78333336 0.02280702 0.14629629
 0.51666665 0.04259259 0.0245614  0.14259259 0.56491226 0.51296294
 0.01491228 0.2962963  0.56754386 0.04444445 0.01052632 0.09814814
 0.56754386 0.1537037  0.0122807  0.1388889  0.56754386 0.30555555
 0.01052632 0.03333334 0.56754386 0.34999999 0.01052632 0.15185185
 0.60438597 0.06481481 0.01491228 0.2462963  0.78157896 0.50555557
 0.00877193 0.07777778 0.85350877 0.1        0.01578947 0.16296296
 0.85350877 0.45555556 0.0122807  0.09074074 0.85350877 0.77222222
 0.01491228 0.0962963  0.87456143 0.08888889 0.01491228 0.18518518
 0.87456143 0.41666666 0.01578947 0.16851851 0.95175439 0.47962964
 0.02982456 0.03333334 0.95263159 0.76666665 0.02894737 0.03518518
 0.95614034 0.19629629 0.0254386  0.02777778 0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.18755598366260529, 0.911611020565033], "coordinates_lift": [0.18755598366260529, 0.911611020565033], "text_input": [""]}