Episode ID: 13523541547451114144.338-523.Go to newegg.com
Step ID: 0
Goal: Go to newegg.com

Previous Actions:


Current Screen:
UI Annotations Text: ['G' '' 'newegg near me' 'More locations' '>' '' 'People also ask' ''
 'Newegg have a' 'physical' 'Does' 'store?' '' 'Where is Newegg located?'
 '' 'locations are there?' 'How many Newegg' '' 'New York?' 'ls' 'Newegg'
 'in' 'Feedback' 'Newegg' '' 'https://www.newegg.com >' '...'
 'locations | Newegg.com' 'Search Newegg.com for locations.' 'Get fast'
 'shipping' 'and top-rated customer service.' '' 'People also search for'
 '' '' 'Snapshot' 'Discover' 'Search' 'Collections' 'More' '' '' '' '' ''
 '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_GOOGLE' 'ICON_MIC' 'TEXT' 'TEXT' 'TEXT' 'ICON_THREE_DOTS' 'TEXT'
 'ICON_V_DOWNWARD' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_V_DOWNWARD' 'TEXT'
 'ICON_V_DOWNWARD' 'TEXT' 'TEXT' 'ICON_V_DOWNWARD' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_THREE_DOTS' 'TEXT' 'ICON_MAGNIFYING_GLASS'
 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT' 'ICON_V_BACKWARD' '' '' '' ''
 '' '' '' '' '' '']
Positions: [0.05       0.09259259 0.03859649 0.04629629 0.05263158 0.86481482
 0.03421053 0.03148148 0.06578948 0.21666667 0.01666667 0.3425926
 0.14649123 0.32962963 0.01403509 0.26851851 0.14736842 0.64074075
 0.0122807  0.01481481 0.22894737 0.93333334 0.0254386  0.01481481
 0.23596491 0.04629629 0.0254386  0.39629629 0.30175439 0.91111112
 0.01666667 0.02592593 0.30350876 0.15000001 0.01929825 0.27037036
 0.30350876 0.43703705 0.01929825 0.14259259 0.30438596 0.04629629
 0.01403509 0.08703703 0.30438596 0.59629631 0.01403509 0.10740741
 0.36491227 0.91111112 0.01578947 0.02592593 0.36578947 0.04444445
 0.01842105 0.47777778 0.42631578 0.91111112 0.01666667 0.02592593
 0.42719299 0.40925926 0.01491228 0.35185185 0.42807019 0.04629629
 0.01842105 0.34629631 0.4877193  0.91111112 0.01666667 0.02407407
 0.48947367 0.29074073 0.01491228 0.18703704 0.49035087 0.04629629
 0.01403509 0.02592593 0.49035087 0.08888889 0.01754386 0.14259259
 0.49035087 0.24814814 0.01403509 0.02592593 0.54035085 0.82592595
 0.0122807  0.13148148 0.60350877 0.15185185 0.01754386 0.15185185
 0.60877192 0.93333334 0.02368421 0.01481481 0.62982458 0.15185185
 0.01578947 0.42037037 0.64122808 0.58703703 0.00175439 0.02222222
 0.66666669 0.04629629 0.02631579 0.6240741  0.71228069 0.04444445
 0.01842105 0.62222224 0.71228069 0.68148148 0.01491228 0.14074074
 0.7403509  0.04444445 0.01842105 0.15000001 0.7403509  0.20925926
 0.01842105 0.57222223 0.80701756 0.93333334 0.0254386  0.01481481
 0.81315792 0.04629629 0.0254386  0.57407409 0.88157892 0.47777778
 0.02807018 0.03518518 0.88771927 0.85370368 0.01578947 0.03518518
 0.91666669 0.23703703 0.01578947 0.14814815 0.91754389 0.05555556
 0.0122807  0.14259259 0.91754389 0.44444445 0.0122807  0.10925926
 0.91754389 0.59629631 0.0122807  0.18148148 0.91754389 0.83333331
 0.0122807  0.08148148 0.95526314 0.47962964 0.02982456 0.03518518
 0.95526314 0.76851851 0.02894737 0.03333334 0.95614034 0.19629629
 0.02894737 0.02777778 0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.6238576769828796, 0.07360528409481049], "coordinates_lift": [0.6238576769828796, 0.07360528409481049], "text_input": [""]}