Episode ID: 5335633733612551778.372-394.Go to Google search
Step ID: 0
Goal: Go to Google search

Previous Actions:


Current Screen:
UI Annotations Text: ['..' 'Delivery' 'C' 'Thekevkev' '' 'G' '' 'newegg near me'
 'More locations' '>' '' 'People also ask' '' 'Newegg have a' 'physical'
 'Does' 'store?' '' 'Where is Newegg located?' '' 'locations are there?'
 'How many Newegg' '' 'Is' 'Newegg' 'New York?' 'in' 'Feedback' 'Newegg'
 '' 'https://www.newegg.com » d=nearest' 'nearest | Newegg.com' 'Onnah a'
 'nn nm far nonrnnt' 'nat fant nhinnin' '' '*' 'ee' 'Snapshot' 'Search'
 'Collections' 'Discover' 'More' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_V_UPWARD' 'ICON_GOOGLE' 'ICON_MIC'
 'TEXT' 'TEXT' 'TEXT' 'ICON_THREE_DOTS' 'TEXT' 'ICON_V_DOWNWARD' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_V_DOWNWARD' 'TEXT' 'ICON_V_DOWNWARD' 'TEXT'
 'TEXT' 'ICON_V_DOWNWARD' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_MAGNIFYING_GLASS' 'TEXT' 'ICON_THREE_DOTS' 'TEXT' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT' 'ICON_V_BACKWARD'
 '' '' '' '' '' '' '' '']
Positions: [1.09649122e-01 8.18518519e-01 8.77193001e-04 2.22222228e-02
 1.14912279e-01 9.44444463e-02 1.75438598e-02 1.38888896e-01
 1.75438598e-01 4.62962948e-02 1.49122803e-02 2.40740739e-02
 1.75438598e-01 9.25925896e-02 1.75438598e-02 2.27777779e-01
 1.81578949e-01 8.62962961e-01 1.57894734e-02 1.85185187e-02
 2.02631578e-01 9.44444463e-02 3.77192982e-02 4.25925925e-02
 2.04385966e-01 8.64814818e-01 3.50877196e-02 3.14814821e-02
 2.19298244e-01 2.16666669e-01 1.75438598e-02 3.42592597e-01
 2.98245609e-01 3.29629630e-01 1.40350880e-02 2.68518507e-01
 2.99122810e-01 6.40740752e-01 1.22807017e-02 1.29629625e-02
 3.82456154e-01 9.33333337e-01 2.45614033e-02 1.29629625e-02
 3.87719303e-01 4.62962948e-02 2.63157897e-02 3.94444436e-01
 4.54385966e-01 9.11111116e-01 1.75438598e-02 2.59259250e-02
 4.55263168e-01 1.50000006e-01 1.92982461e-02 2.70370364e-01
 4.55263168e-01 4.37037051e-01 1.92982461e-02 1.42592594e-01
 4.56140339e-01 4.62962948e-02 1.40350880e-02 8.70370343e-02
 4.56140339e-01 5.96296310e-01 1.40350880e-02 1.07407406e-01
 5.14912307e-01 9.11111116e-01 1.66666675e-02 2.40740739e-02
 5.17543852e-01 4.44444455e-02 1.75438598e-02 4.77777779e-01
 5.77192962e-01 9.11111116e-01 1.66666675e-02 2.40740739e-02
 5.78947365e-01 4.09259260e-01 1.49122803e-02 3.51851851e-01
 5.79824567e-01 4.62962948e-02 1.75438598e-02 3.46296310e-01
 6.39473677e-01 9.11111116e-01 1.66666675e-02 2.59259250e-02
 6.41228080e-01 4.62962948e-02 1.49122803e-02 2.59259250e-02
 6.41228080e-01 8.88888910e-02 1.84210520e-02 1.42592594e-01
 6.41228080e-01 2.90740728e-01 1.49122803e-02 1.87037036e-01
 6.42105281e-01 2.48148143e-01 1.40350880e-02 2.59259250e-02
 6.91228092e-01 8.25925946e-01 1.40350880e-02 1.31481484e-01
 7.55263150e-01 1.51851848e-01 1.57894734e-02 1.51851848e-01
 7.59649098e-01 9.33333337e-01 2.45614033e-02 1.48148146e-02
 7.81578958e-01 1.51851848e-01 1.57894734e-02 5.88888884e-01
 8.20175409e-01 4.62962948e-02 2.54385956e-02 5.85185170e-01
 8.62280726e-01 4.44444455e-02 1.05263162e-02 1.85185179e-01
 8.62280726e-01 2.72222221e-01 1.05263162e-02 3.53703707e-01
 8.64035070e-01 6.49999976e-01 7.89473671e-03 2.81481475e-01
 8.82456124e-01 4.77777779e-01 2.71929819e-02 3.51851843e-02
 8.84210527e-01 1.00000001e-01 2.54385956e-02 5.18518500e-02
 8.87719274e-01 8.53703678e-01 1.57894734e-02 3.33333351e-02
 9.16666687e-01 2.37037033e-01 1.57894734e-02 1.50000006e-01
 9.16666687e-01 4.44444448e-01 1.31578948e-02 1.09259263e-01
 9.16666687e-01 5.96296310e-01 1.31578948e-02 1.81481481e-01
 9.17543888e-01 5.55555560e-02 1.22807017e-02 1.42592594e-01
 9.17543888e-01 8.33333313e-01 1.22807017e-02 8.14814791e-02
 9.54385936e-01 4.79629636e-01 3.07017546e-02 3.51851843e-02
 9.55263138e-01 7.68518507e-01 2.89473683e-02 3.33333351e-02
 9.56140339e-01 1.94444448e-01 2.89473683e-02 2.96296291e-02
 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00
 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00
 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00
 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00
 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00
 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00
 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00
 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.21349133551120758, 0.5022215843200684], "coordinates_lift": [0.21349133551120758, 0.5022215843200684], "text_input": [""]}