Episode ID: 10533353326262031581.702-751.go to cart
Step ID: 0
Goal: go to cart

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' 'google.com/amp/s/wn' '' '' 'newegg.com' '' '' '' '(hewegg' 'Q'
 'Keywords,' 'Model #, Item #' "Today's" 'Deals' 'Sellers' 'Best' 'Best'
 'Newegg LIVE' 'Newegg C' 'newegg' 'NOW' 'Discover New' '' '' 'Products'
 'With Deals and' 'Demos' '750W 80+ Gold' 'AnimeRIDO' 'Every Week' '94.'
 'S769.00' 'Wish' 'Orders' 'List' 'Categories' '' "TODAY'S BEST DEALS" '?'
 'X' 'Google uses your location to' 'local' 'You can' 'give you'
 'content.' 'change this in Settings.' '' '']
UI Annotations Types: ['ICON_HOME' 'ICON_THREE_DOTS' 'TEXT' 'ICON_SHARE' 'ICON_INFO' 'TEXT'
 'ICON_SHOPPING_CART' 'ICON_THREE_BARS' 'ICON_PERSON' 'TEXT'
 'ICON_MAGNIFYING_GLASS' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_PLAY' 'ICON_PLAY' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_V_FORWARD' 'TEXT' 'ICON_LOCATION' 'ICON_X' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_CIRCLE']
Positions: [0.04649123 0.04074074 0.02894737 0.03518518 0.04824561 0.91851854
 0.02982456 0.01666667 0.05438596 0.23148148 0.02192982 0.49814814
 0.1008772  0.92592591 0.0254386  0.02777778 0.10263158 0.04444445
 0.02368421 0.02962963 0.1122807  0.40000001 0.01140351 0.2
 0.14122806 0.76666665 0.03596491 0.04444445 0.14298245 0.0537037
 0.03421053 0.04074074 0.14298245 0.90370369 0.03508772 0.03518518
 0.15175438 0.17777778 0.0245614  0.15925926 0.2        0.06111111
 0.02280702 0.02592593 0.20614035 0.11481482 0.01578947 0.1537037
 0.20614035 0.28333333 0.01403509 0.23888889 0.25438598 0.04074074
 0.01491228 0.11851852 0.25438598 0.25185186 0.01140351 0.08333334
 0.25438598 0.45740741 0.01140351 0.10185185 0.25526315 0.17407407
 0.01052632 0.06481481 0.25526315 0.38148147 0.01052632 0.06481481
 0.25526315 0.60555553 0.01403509 0.19814815 0.25526315 0.85000002
 0.01403509 0.14259259 0.31140351 0.44814816 0.00964912 0.07592592
 0.31140351 0.54074073 0.00877193 0.04814815 0.34035087 0.34074074
 0.01666667 0.31481481 0.35438597 0.12777779 0.0254386  0.02777778
 0.35438597 0.85555553 0.0254386  0.02777778 0.3622807  0.39444444
 0.01578947 0.21111111 0.38508773 0.39259258 0.01140351 0.21666667
 0.40000001 0.4462963  0.01140351 0.10185185 0.40526316 0.08148148
 0.00877193 0.18333334 0.40701753 0.72037035 0.01052632 0.14259259
 0.41315788 0.41666666 0.01315789 0.16666667 0.41754386 0.14444445
 0.00789474 0.04259259 0.41754386 0.75925928 0.00701754 0.07407407
 0.53771931 0.43703705 0.01315789 0.06851852 0.53859651 0.13333334
 0.01140351 0.0962963  0.53859651 0.51666665 0.01140351 0.04074074
 0.53947371 0.74629629 0.01403509 0.14814815 0.59473681 0.93333334
 0.02894737 0.02222222 0.60350877 0.03888889 0.01491228 0.43148148
 0.83596492 0.05740741 0.02894737 0.02407407 0.83596492 0.91296297
 0.02982456 0.03148148 0.84473681 0.12592593 0.02192982 0.6111111
 0.87105262 0.31666666 0.01842105 0.0962963  0.87192982 0.62037039
 0.01754386 0.17037037 0.87280703 0.12407407 0.02105263 0.17407407
 0.87368423 0.43148148 0.01666667 0.17222223 0.89736843 0.12407407
 0.0245614  0.49814814 0.95614034 0.19629629 0.02807018 0.02777778
 0.95701754 0.48148149 0.02719298 0.03148148]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.16726593673229218, 0.7832859754562378], "coordinates_lift": [0.16726593673229218, 0.7832859754562378], "text_input": [""]}