Episode ID: 193698001785153836.335-367.Go to newegg cart 
Step ID: 0
Goal: Go to newegg cart 

Previous Actions:


Current Screen:
UI Annotations Text: ['Computer Parts, PC C...' '' '' '' 'A' 'delivered by' 'From newegg.com-'
 '' '' '' 'Q' 'Keywords, Model #,' 'Item #' "Today's" 'Deals' 'Sellers'
 'Save on AMD' 'Best' 'Best' 'Newegg LIVE' 'SHOP IN' 'HIGH SPIRITS'
 'Up to 59% off Gaming Furniture,' '3D Printers & More' 'Orders' 'Wish'
 'List' 'Categories' '' "TODAY'S BEST DEALS" 'ptop' "Domino's" 'WD Red' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['TEXT' 'ICON_X' 'ICON_SHARE' 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT'
 'ICON_SHOPPING_CART' 'ICON_PERSON' 'ICON_THREE_BARS'
 'ICON_MAGNIFYING_GLASS' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_V_FORWARD' 'TEXT' 'TEXT' 'TEXT' 'TEXT' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.04652778 0.1875     0.02083333 0.42777777 0.04722222 0.04166667
 0.02708333 0.02916667 0.04722222 0.82361114 0.03194445 0.03333334
 0.04861111 0.93472224 0.02916667 0.01666667 0.05416667 0.1375
 0.01458333 0.02638889 0.07083333 0.4861111  0.01527778 0.15972222
 0.07152778 0.1875     0.01458333 0.28611112 0.10277778 0.77638888
 0.03680556 0.04444445 0.10555556 0.90694445 0.03472222 0.03611111
 0.10694444 0.05       0.03194445 0.0375     0.16388889 0.06111111
 0.02291667 0.025      0.16875    0.10972222 0.01666667 0.28333333
 0.16944444 0.40694445 0.01180556 0.09305555 0.21805556 0.04027778
 0.01527778 0.1125     0.21805556 0.24027778 0.01180556 0.07916667
 0.21805556 0.4375     0.01180556 0.09722222 0.21805556 0.80972224
 0.01180556 0.18194444 0.21875    0.16527778 0.01111111 0.0625
 0.21875    0.36388889 0.01111111 0.0625     0.21875    0.5777778
 0.01458333 0.18888889 0.26319444 0.15555556 0.02222222 0.24027778
 0.29027778 0.09444445 0.02222222 0.38333333 0.32499999 0.09166667
 0.0125     0.39166668 0.33958334 0.17777778 0.00972222 0.22777778
 0.51249999 0.13472222 0.0125     0.09166667 0.51249999 0.44166666
 0.01180556 0.06388889 0.5138889  0.51666665 0.01111111 0.04166667
 0.5138889  0.75138891 0.01319444 0.14166667 0.56805557 0.9375
 0.03125    0.02222222 0.5777778  0.0375     0.01527778 0.41249999
 0.63819444 0.7027778  0.00416667 0.025      0.64305556 0.47361112
 0.00694444 0.0625     0.64791667 0.31388888 0.00486111 0.04722222
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.1345459669828415, 0.8109019994735718], "coordinates_lift": [0.1345459669828415, 0.8109019994735718], "text_input": [""]}