Episode ID: 7295198672331897000.812-1079.Search on walmart on google
Step ID: 0
Goal: Search on walmart on google

Previous Actions:


Current Screen:
UI Annotations Text: ['G' '' 'Search...' '' 'ebay' '' 'Target' '' 'amazon' '' 'flights from'
 'nyc to buenos aires' '' 'bestbuy' '' 'newegg' '' 'COstco' ''
 'newegg promo code' '' 'hotels' 'in' 'las' 'vegas' '' 'what is the speed'
 'of a plane' '' 'good' 'bbq' 'restaurants' '' 'good' 'indian'
 'restaurants' 'search for flights from' 'buenos aires to' ''
 'helsinki finland' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_GOOGLE' 'ICON_MIC' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT'
 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT'
 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT'
 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_TIME'
 'TEXT' 'ICON_NAV_BAR_CIRCLE' 'ICON_NAV_BAR_RECT' 'ICON_V_BACKWARD' '' ''
 '' '' '']
Positions: [0.04605263 0.06805556 0.0368421  0.04027778 0.04868421 0.89444447
 0.03289474 0.02777778 0.05921053 0.18333334 0.01315789 0.12916666
 0.12368421 0.07083333 0.03026316 0.03472222 0.13289474 0.18333334
 0.01578947 0.07361111 0.18618421 0.07083333 0.03026316 0.03472222
 0.19605263 0.18333334 0.01578947 0.1        0.24802631 0.07083333
 0.03092105 0.03472222 0.26118422 0.18333334 0.00921053 0.125
 0.31052631 0.07083333 0.03026316 0.03472222 0.31973684 0.18194444
 0.01644737 0.18333334 0.31973684 0.37916666 0.01644737 0.30972221
 0.37236843 0.07083333 0.03092105 0.03611111 0.38157895 0.18333334
 0.01644737 0.125      0.43486843 0.07083333 0.03092105 0.03611111
 0.44736841 0.18333334 0.01315789 0.12222222 0.49736843 0.07083333
 0.03092105 0.03472222 0.50789475 0.18194444 0.01315789 0.10694444
 0.5598684  0.07083333 0.02828947 0.03472222 0.56842107 0.18333334
 0.01776316 0.32499999 0.62171054 0.07083333 0.02828947 0.03472222
 0.63026315 0.18333334 0.01315789 0.09583333 0.63092107 0.29305556
 0.0125     0.02361111 0.63092107 0.33055556 0.0125     0.04305556
 0.63355261 0.38611111 0.01315789 0.09166667 0.68421054 0.07222223
 0.02828947 0.03472222 0.69276315 0.18194444 0.01578947 0.27916667
 0.69276315 0.47499999 0.01578947 0.15416667 0.74605262 0.07361111
 0.02894737 0.03333334 0.75460523 0.18333334 0.01578947 0.07777778
 0.75460523 0.27500001 0.01578947 0.05555556 0.75657892 0.34444445
 0.01118421 0.18055555 0.80855262 0.07222223 0.02894737 0.03472222
 0.81710523 0.18333334 0.01578947 0.07777778 0.81710523 0.27500001
 0.01315789 0.09305555 0.81842107 0.38194445 0.01184211 0.17916666
 0.86907893 0.18333334 0.01644737 0.35555556 0.86907893 0.55277777
 0.01315789 0.24444444 0.87105262 0.07222223 0.02828947 0.03333334
 0.88947368 0.18333334 0.01315789 0.2375     0.95657897 0.47916666
 0.02894737 0.03333334 0.95657897 0.76944447 0.02828947 0.03055556
 0.95789474 0.19583334 0.02697368 0.02777778 0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 3, "action_description": "Describe what the action means if needed", "coordinates_touch": [-1.0, -1.0], "coordinates_lift": [-1.0, -1.0], "text_input": ["walmart"]}