Episode ID: 1930592472624269741.336-370.go to Newegg 
Step ID: 0
Goal: go to Newegg 

Previous Actions:


Current Screen:
UI Annotations Text: ['Google' '' '' 'newegg uk' 'MAPS' 'ALL' 'NEWS' 'SHOPPING' 'VIDEOS'
 'IMAGES' 'Newegg' '' 'https://www.newegg.com > uk-en'
 'laptops, electronics,' 'and' 'Computer parts,' 'more - Newegg United'
 'Kingdom' '' 'People also search for' 'newegg' 'Q' '' 'Q'
 'overclockers uk' 'newegg us' 'shipping' 'newegg' 'Q' '' 'Q' 'ebuyer uk'
 'scan uk' 'europe' 'Newegg.com' '' 'https://www.newegg.com » bh-en'
 'Computer Parts,' 'PC Components,' 'Laptop' 'Digital Cameras ...'
 'Computers,' 'LED LCD TV,' 'offers the best prices on' 'Newegg.com'
 'Computer Parts,' 'PC' 'Components,' 'Laptops,' '...' 'Video Cards'
 'WD 1TB My Passport Wireless..' '3.5m' 'Daanla' 'alaa' 'aale' '' ''
 'Discover' 'Updates' 'Search' 'Recent' 'More' '' '' '' '' '' '' '' '' ''
 '' '' '' '']
UI Annotations Types: ['TEXT' 'ICON_MIC' 'ICON_MAGNIFYING_GLASS' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_X' 'TEXT' 'TEXT' 'ICON_MAGNIFYING_GLASS'
 'ICON_MAGNIFYING_GLASS' 'ICON_MAGNIFYING_GLASS' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'ICON_MAGNIFYING_GLASS' 'ICON_MAGNIFYING_GLASS'
 'ICON_MAGNIFYING_GLASS' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_THREE_DOTS'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_MAGNIFYING_GLASS' 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_CIRCLE' '' '' '' '' '' '' '' '' ''
 '' '']
Positions: [0.04861111 0.3888889  0.03611111 0.22499999 0.11319444 0.89999998
 0.03194445 0.02777778 0.11736111 0.06666667 0.02916667 0.03472222
 0.12430555 0.17083333 0.01805556 0.17777778 0.17777778 0.88611114
 0.01180556 0.07361111 0.17847222 0.0375     0.01041667 0.04722222
 0.17847222 0.16388889 0.01111111 0.075      0.17847222 0.31666666
 0.01041667 0.1375     0.17847222 0.53194445 0.01041667 0.09722222
 0.17847222 0.70694447 0.01041667 0.1        0.22916667 0.13333334
 0.01388889 0.11805555 0.23541667 0.94166666 0.02291667 0.01388889
 0.25208333 0.13333334 0.01388889 0.4138889  0.28611112 0.38749999
 0.02291667 0.40833333 0.28611112 0.8125     0.01805556 0.07222223
 0.28680557 0.04027778 0.02222222 0.33055556 0.31597221 0.04027778
 0.02291667 0.45416668 0.31597221 0.5138889  0.02291667 0.17916666
 0.36527777 0.93194443 0.02222222 0.02222222 0.375      0.04027778
 0.02083333 0.43055555 0.42569444 0.36388889 0.01180556 0.09583333
 0.42777777 0.0625     0.02291667 0.02777778 0.42777777 0.30972221
 0.02361111 0.02777778 0.42777777 0.52916664 0.02361111 0.02638889
 0.43472221 0.58194447 0.01041667 0.19305556 0.43611112 0.11666667
 0.01180556 0.13194445 0.44374999 0.36388889 0.01319444 0.1
 0.49583334 0.34861112 0.01180556 0.09444445 0.49722221 0.0625
 0.025      0.02638889 0.49791667 0.29444444 0.02291667 0.02638889
 0.49791667 0.50416666 0.02291667 0.02638889 0.50486112 0.11527777
 0.01319444 0.11944444 0.50486112 0.55833334 0.01041667 0.09444445
 0.5173611  0.34861112 0.01041667 0.08472222 0.59027779 0.13333334
 0.01458333 0.19027779 0.59583336 0.94166666 0.02291667 0.01388889
 0.61319447 0.13333334 0.01319444 0.41527778 0.64791667 0.04027778
 0.02152778 0.33333334 0.64791667 0.39166668 0.02152778 0.34166667
 0.64791667 0.75138891 0.02152778 0.1375     0.67569447 0.55694443
 0.025      0.37638888 0.67708331 0.04027778 0.02222222 0.23472223
 0.67708331 0.29305556 0.02083333 0.24583334 0.71527779 0.24027778
 0.01597222 0.34999999 0.71597224 0.04027778 0.01597222 0.1875
 0.71597224 0.60277778 0.01527778 0.23333333 0.71597224 0.84861112
 0.01180556 0.0375     0.73888886 0.03888889 0.01527778 0.19027779
 0.73888886 0.24166666 0.01597222 0.12083333 0.74930555 0.375
 0.00208333 0.02083333 0.78888887 0.07777778 0.01319444 0.1736111
 0.78888887 0.35416666 0.01666667 0.4611111  0.78958333 0.92638886
 0.0125     0.06666667 0.86944443 0.04027778 0.00902778 0.1388889
 0.86944443 0.19722222 0.00902778 0.08194444 0.86944443 0.29722223
 0.00902778 0.06944445 0.88819444 0.48055556 0.025      0.02916667
 0.89375001 0.8611111  0.01458333 0.02916667 0.91874999 0.06666667
 0.01180556 0.10972222 0.91944444 0.25694445 0.01319444 0.10833333
 0.91944444 0.45416668 0.01041667 0.08888889 0.91944444 0.64305556
 0.01111111 0.0875     0.91944444 0.84444445 0.01111111 0.06527778
 0.95763886 0.19583334 0.02569444 0.02638889 0.95763886 0.4861111
 0.02708333 0.02916667 0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.2967066466808319, 0.26949018239974976], "coordinates_lift": [0.2967066466808319, 0.26949018239974976], "text_input": [""]}