Episode ID: 15699153682121356353.1214-1216.Enter in the Google search bar: ebay
Step ID: 0
Goal: Enter in the Google search bar: ebay

Previous Actions:


Current Screen:
UI Annotations Text: ['G' '' 'Search apps, web, and' 'more.' '' 'ebay' 'eBay' 'R' ''
 'newegg.com' '' 'COSTCO' 'Costco' '' 'ebay.com' '' 'M' '31' '' 'YouTube'
 'Photos' 'Calendar' 'Gmail' 'Maps' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '']
UI Annotations Types: ['ICON_GOOGLE' 'ICON_MIC' 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT' 'TEXT'
 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT'
 'ICON_LOCATION' 'ICON_ENVELOPE' 'ICON_CALENDAR' 'ICON_PLAY' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_RECT'
 'ICON_NAV_BAR_CIRCLE' '' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.04814815 0.06111111 0.03611111 0.03888889 0.04907407 0.89999998
 0.03425926 0.02777778 0.05740741 0.16666667 0.0212963  0.36481482
 0.06388889 0.5462963  0.01111111 0.08148148 0.11666667 0.06481481
 0.02962963 0.03333334 0.12129629 0.74259257 0.0212963  0.10555556
 0.125      0.16851851 0.01759259 0.07592592 0.125      0.90185183
 0.01388889 0.02962963 0.17685185 0.06481481 0.02685185 0.03148148
 0.18703704 0.16851851 0.01574074 0.2074074  0.23796296 0.06481481
 0.02685185 0.02962963 0.24444444 0.74814814 0.01481481 0.0962963
 0.2462963  0.16851851 0.01388889 0.11481482 0.29722223 0.06481481
 0.02685185 0.03148148 0.30648148 0.16851851 0.01574074 0.15555556
 0.38333333 0.85925925 0.04814815 0.04259259 0.38425925 0.27777779
 0.03981481 0.05185185 0.38703704 0.66666669 0.03888889 0.04814815
 0.39351851 0.09814814 0.02222222 0.02777778 0.45092592 0.06111111
 0.01203704 0.10925926 0.45092592 0.45925927 0.01203704 0.07962963
 0.45092592 0.6388889  0.01203704 0.10925926 0.45185184 0.27407408
 0.01018518 0.06666667 0.45185184 0.85370368 0.01296296 0.05925926
 0.95555556 0.19074073 0.0287037  0.02962963 0.95555556 0.77222222
 0.0287037  0.02962963 0.95740741 0.48148149 0.02685185 0.03148148
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 3, "action_description": "Describe what the action means if needed", "coordinates_touch": [-1.0, -1.0], "coordinates_lift": [-1.0, -1.0], "text_input": [" ebay"]}