Episode ID: 17492973037854708029.1584-1601.Add to cart
Step ID: 0
Goal: Add to cart

Previous Actions:


Current Screen:
UI Annotations Text: ['Q' '' '' 'Reviews' 'Details' 'Overview' 'NUI' 'guJUVIg' 'UVIEVY ƏUNE'
 'Edit' 'Options' 'No, G910 Orion Spark,' 'No' 'Plan:' 'Protection' 'None'
 'Edit' '+' 'Quantity:' '1' '@ADD TO WISH LIST' '' 'Add to Compare'
 'Keychron' 'K8' 'Hot-swappable Wireless' 'Bluetooth' '5.1/Wired' 'USB'
 'Mechanical' 'Gami...' '' '$87.99' 'O Sponsored' '' 'More Infos' 'O'
 '14 0ffers From $84.99' '' 'Used,' 'Refurbished' '11' 'New,' '2' '1'
 'See more "Top Rated Gaming Keyboard' '' 'Under $200"' '' '' ''
 'ADD TO CART' 'BUY NOW' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_MAGNIFYING_GLASS' 'ICON_PERSON' 'ICON_THREE_BARS' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_PLUS' 'TEXT' 'TEXT' 'TEXT' 'ICON_PLUS' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_INFO' 'TEXT'
 'TEXT' 'ICON_NOTIFICATIONS' 'TEXT' 'TEXT' 'TEXT' 'ICON_CHAT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_V_FORWARD' 'TEXT'
 'ICON_SHOPPING_CART' 'ICON_SHARE' 'ICON_PLUS' 'TEXT' 'TEXT'
 'ICON_NAV_BAR_CIRCLE' 'ICON_V_BACKWARD' '' '' '' '' '' '' '' '']
Positions: [0.03859649 0.81111109 0.0368421  0.04629629 0.03859649 0.9222222
 0.0377193  0.03888889 0.04035088 0.03888889 0.03333334 0.04074074
 0.05263158 0.29814816 0.01052632 0.10925926 0.05263158 0.43333334
 0.01052632 0.09259259 0.05263158 0.55185187 0.01052632 0.13148148
 0.08333334 0.02222222 0.0122807  0.09074074 0.08333334 0.16111112
 0.0122807  0.20185184 0.08333334 0.41296297 0.0122807  0.2074074
 0.15087719 0.89629632 0.01578947 0.07037037 0.15175438 0.03518518
 0.01929825 0.16481481 0.19385965 0.03703704 0.02017544 0.42592594
 0.19473684 0.47962964 0.01491228 0.05185185 0.25350878 0.25
 0.01578947 0.08703703 0.25438598 0.03703704 0.01491228 0.19444445
 0.25438598 0.35555556 0.01491228 0.1        0.25438598 0.89629632
 0.01578947 0.06851852 0.31403509 0.90370369 0.02894737 0.03148148
 0.31929824 0.03703704 0.02105263 0.17222223 0.32105264 0.80555558
 0.01842105 0.01296296 0.40087721 0.28148147 0.02192982 0.43703705
 0.40438595 0.30555555 0.02105263 0.02222222 0.45964912 0.34074074
 0.02105263 0.35370371 0.5350877  0.2037037  0.01578947 0.15185185
 0.5350877  0.37222221 0.01315789 0.03703704 0.5350877  0.42407408
 0.01578947 0.40000001 0.55877191 0.2037037  0.01315789 0.15925926
 0.55877191 0.37777779 0.01315789 0.15925926 0.55877191 0.55185187
 0.01315789 0.06481481 0.55877191 0.63148147 0.01315789 0.18333334
 0.55877191 0.8296296  0.01315789 0.11296296 0.58421052 0.78518516
 0.01578947 0.01851852 0.58508772 0.2037037  0.01666667 0.12592593
 0.58684212 0.7814815  0.01491228 0.17222223 0.64298248 0.94814813
 0.02894737 0.02962963 0.65964913 0.03703704 0.01578947 0.22592592
 0.71754384 0.06666667 0.02192982 0.06666667 0.72105265 0.1537037
 0.01754386 0.42777777 0.7517544  0.88148147 0.02982456 0.03703704
 0.75438595 0.35370371 0.01754386 0.1037037  0.75438595 0.50925928
 0.01578947 0.22962964 0.75526315 0.1537037  0.01491228 0.03518518
 0.75526315 0.21111111 0.01666667 0.09074074 0.75526315 0.31851852
 0.01491228 0.01851852 0.75526315 0.47407407 0.01491228 0.01111111
 0.81842107 0.06851852 0.02017544 0.77407408 0.82719296 0.90925926
 0.0245614  0.01851852 0.84561402 0.07037037 0.01666667 0.24814814
 0.89210528 0.02777778 0.03157895 0.03888889 0.89298248 0.13518518
 0.03333334 0.03518518 0.90438598 0.26296297 0.02017544 0.02037037
 0.90438598 0.37962964 0.0122807  0.23703703 0.90438598 0.73333335
 0.0122807  0.17407407 0.95350879 0.47777778 0.03157895 0.03518518
 0.95526314 0.22962964 0.02982456 0.03148148 0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.9014931917190552, 0.5374646782875061], "coordinates_lift": [0.9014931917190552, 0.5374646782875061], "text_input": [""]}