Episode ID: 14634275235985577530.248-250.type newegg on google search bar
Step ID: 0
Goal: type newegg on google search bar

Previous Actions:


Current Screen:
UI Annotations Text: ['G' '' 'Search apps, web, and mor...' '' 'ebay' '' 'walmart' '' 'bestbuy'
 '' 'target' 'FROM YOUR APPS' '' '' '' '' '1' 'Clock' 'Play Store'
 'Calendar' 'Settings' 'Maps' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_GOOGLE' 'ICON_MIC' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT'
 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT' 'ICON_TIME' 'ICON_SETTINGS'
 'ICON_PLAY' 'ICON_LOCATION' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_NAV_BAR_RECT' 'ICON_V_BACKWARD' '' '' '' '' '' '' '' '' '' '' '' '']
Positions: [0.07513661 0.08009709 0.05327869 0.05582524 0.07923497 0.86893207
 0.04371585 0.03883495 0.09289618 0.22330096 0.02322404 0.54126215
 0.17486338 0.08495145 0.04371585 0.0461165  0.18989071 0.22330096
 0.0204918  0.08495145 0.26639345 0.08495145 0.04234973 0.0461165
 0.27868852 0.22330096 0.01912568 0.15533981 0.35655737 0.08737864
 0.04098361 0.04368932 0.36748633 0.22330096 0.02322404 0.15048544
 0.44672132 0.08495145 0.04371585 0.04854369 0.46174863 0.22087379
 0.0204918  0.11407767 0.53142077 0.07524272 0.01502732 0.31067961
 0.57650274 0.07281554 0.07923497 0.09466019 0.58196723 0.4538835
 0.06830601 0.0776699  0.58469945 0.27669904 0.06147541 0.06067961
 0.58606559 0.842233   0.05874317 0.05339806 0.60928965 0.6747573
 0.02322404 0.01699029 0.68169397 0.08252427 0.0136612  0.07038835
 0.68169397 0.24271844 0.01775956 0.13349515 0.68169397 0.62864077
 0.0136612  0.11650486 0.68306011 0.44417477 0.01639344 0.09951457
 0.68306011 0.83980584 0.01639344 0.07281554 0.93579233 0.72330099
 0.04234973 0.0461165  0.93989068 0.22572815 0.03551913 0.03640777
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 3, "action_description": "Describe what the action means if needed", "coordinates_touch": [-1.0, -1.0], "coordinates_lift": [-1.0, -1.0], "text_input": ["newegg"]}