Episode ID: 15529516037020227210.569-664.Go to cart
Step ID: 0
Goal: Go to cart

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'newegg.com' '' '' '' '=(powegs' 'TODAYS' 'DEALS' 'Q' 'Keywords,'
 'Model #,' 'Item #' '' 'Hello Select address' 'Gift Cards'
 'Browsing History' 'PC Builder' 'Gami' 'NOW' 'Discover New' '' ''
 'Products' '' 'Ki' 'With Deals and' 'mos' 'Gole' 'S369.00' 'Week' 'Fverv'
 'Orders' 'Wish' 'List' 'Categories' '' '' "TODAY'S BEST DEALS" '20' '51'
 '10' 'Ending' 'in:' ':' ':' 'Saue 200%' 'Save 200A' '' '']
UI Annotations Types: ['ICON_THREE_DOTS' 'ICON_HOME' 'TEXT' 'ICON_SHOPPING_CART'
 'ICON_THREE_BARS' 'ICON_PERSON' 'TEXT' 'TEXT' 'TEXT'
 'ICON_MAGNIFYING_GLASS' 'TEXT' 'TEXT' 'TEXT' 'ICON_LOCATION' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_PLAY' 'ICON_PLAY' 'TEXT'
 'ICON_NOTIFICATIONS' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_HEART' 'ICON_CHAT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_V_BACKWARD'
 'ICON_NAV_BAR_RECT']
Positions: [0.06967213 0.90048546 0.03825137 0.02184466 0.07103825 0.05097087
 0.03825137 0.04368932 0.08606558 0.27912623 0.01639344 0.21359223
 0.14617486 0.77912623 0.05054645 0.05582524 0.15300547 0.04126213
 0.04644809 0.04854369 0.15300547 0.9174757  0.04918033 0.04854369
 0.1625683  0.03640777 0.03688525 0.33495146 0.1693989  0.5825243
 0.01775956 0.14320388 0.18032786 0.64320385 0.01229508 0.07038835
 0.23770492 0.0776699  0.03005465 0.0315534  0.24590164 0.14077669
 0.0204918  0.18446602 0.24590164 0.34466019 0.01912568 0.15533981
 0.24590164 0.51941746 0.01639344 0.11650486 0.30191258 0.03640777
 0.04234973 0.0315534  0.31557378 0.10194175 0.02595628 0.39077669
 0.38251367 0.02669903 0.01639344 0.18689321 0.38251367 0.26941746
 0.0204918  0.32524273 0.38251367 0.64805824 0.01639344 0.19660194
 0.38251367 0.89805824 0.01639344 0.08495145 0.45765027 0.53640777
 0.00956284 0.0461165  0.48907104 0.35436893 0.01912568 0.29368931
 0.50546449 0.8325243  0.02868852 0.02912621 0.50683057 0.15533981
 0.02595628 0.02669903 0.51366121 0.40533981 0.01775956 0.19660194
 0.52185792 0.94660193 0.03551913 0.0315534  0.52595627 0.69174755
 0.02185792 0.03883495 0.53961748 0.40048543 0.01229508 0.2038835
 0.55737704 0.49514562 0.00819672 0.05339806 0.5614754  0.23058252
 0.0068306  0.04854369 0.56693989 0.73058254 0.0136612  0.09466019
 0.56967211 0.50485438 0.01229508 0.0776699  0.57103825 0.42475727
 0.00819672 0.07281554 0.67076504 0.1262136  0.01639344 0.11650486
 0.67076504 0.42718446 0.01502732 0.08009709 0.67213112 0.52184469
 0.0136612  0.05582524 0.67213112 0.73058254 0.01639344 0.17718446
 0.69808745 0.48058254 0.04371585 0.0461165  0.73497266 0.87135923
 0.03551913 0.04126213 0.8060109  0.04126213 0.02185792 0.54126215
 0.85519123 0.24757281 0.01502732 0.03640777 0.85519123 0.32766989
 0.0136612  0.03398058 0.85519123 0.41019419 0.0136612  0.03640777
 0.85655737 0.04368932 0.0136612  0.11165048 0.85655737 0.1723301
 0.0136612  0.03398058 0.85655737 0.30339807 0.0136612  0.00485437
 0.85792351 0.38349515 0.01229508 0.00728155 0.9002732  0.03883495
 0.01775956 0.16504854 0.90163934 0.51941746 0.01775956 0.16019417
 0.9385246  0.22572815 0.03825137 0.03640777 0.9385246  0.72572815
 0.03825137 0.04126213]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.17101076245307922, 0.820942759513855], "coordinates_lift": [0.17101076245307922, 0.820942759513855], "text_input": [""]}