Episode ID: 4082422899284342133.603-705.Search for amazon.com on chrome
Step ID: 0
Goal: Search for amazon.com on chrome

Previous Actions:


Current Screen:
UI Annotations Text: ['G' '' 'Fearch.' '' 'ebay' '' 'amazon' '' 'flights from'
 'nyc to buenos aires' '' 'Target' '' 'bestbuy' '' 'newegg' '' 'COstco' ''
 'newegg promo code' '' 'hotels' 'in' 'las' 'vegas' '' 'what is the speed'
 'of a plane' '' 'good' 'bbq' 'restaurants' '' 'good' 'indian'
 'restaurants' '' "what's a good" 'las vegas' 'restaurant in'
 'search for fliahts from buenos aires to' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '']
UI Annotations Types: ['ICON_GOOGLE' 'ICON_MIC' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT'
 'ICON_TIME' 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT'
 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME' 'TEXT' 'ICON_TIME'
 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT'
 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT' 'TEXT' 'ICON_TIME' 'TEXT' 'TEXT'
 'TEXT' 'TEXT' 'ICON_NAV_BAR_CIRCLE' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_RECT'
 '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' '' ''
 '' '' '' '' '']
Positions: [0.04539474 0.06805556 0.0381579  0.04166667 0.04868421 0.89444447
 0.03289474 0.02638889 0.05394737 0.18055555 0.0243421  0.13472222
 0.12368421 0.07083333 0.03026316 0.03472222 0.13289474 0.18333334
 0.01513158 0.07361111 0.18618421 0.07083333 0.03026316 0.03472222
 0.19868422 0.18333334 0.00986842 0.125      0.24802631 0.07083333
 0.03092105 0.03472222 0.25723684 0.18194444 0.01513158 0.18333334
 0.25723684 0.37916666 0.01644737 0.30833334 0.31052631 0.07083333
 0.03026316 0.03472222 0.32039472 0.18194444 0.01578947 0.10138889
 0.37236843 0.07083333 0.03092105 0.03472222 0.38092107 0.18333334
 0.01710526 0.125      0.43486843 0.07083333 0.03092105 0.03611111
 0.44736841 0.18333334 0.01315789 0.12222222 0.49736843 0.07083333
 0.03092105 0.03472222 0.50789475 0.18194444 0.01315789 0.10694444
 0.55921054 0.07083333 0.02894737 0.03472222 0.56842107 0.18333334
 0.01776316 0.32499999 0.62171054 0.07222223 0.02828947 0.03333334
 0.63026315 0.18333334 0.01315789 0.09583333 0.63092107 0.29305556
 0.0125     0.02361111 0.63092107 0.33055556 0.0125     0.04305556
 0.63355261 0.38611111 0.01315789 0.09166667 0.68421054 0.07222223
 0.02828947 0.03472222 0.69276315 0.18194444 0.01578947 0.27916667
 0.69276315 0.47499999 0.01578947 0.15416667 0.74605262 0.07222223
 0.02894737 0.03333334 0.75460523 0.18333334 0.01578947 0.07777778
 0.75460523 0.27500001 0.01578947 0.05555556 0.75657892 0.34444445
 0.01118421 0.18055555 0.80855262 0.07083333 0.02894737 0.03611111
 0.81710523 0.18333334 0.01578947 0.07777778 0.81710523 0.27500001
 0.01315789 0.09305555 0.81842107 0.38194445 0.01184211 0.17916666
 0.87105262 0.07222223 0.02828947 0.03333334 0.87894738 0.18194444
 0.01644737 0.21805556 0.87894738 0.62638891 0.01644737 0.14722222
 0.87960523 0.4138889  0.0125     0.19861111 0.93157893 0.1736111
 0.01578947 0.62361109 0.95657897 0.48055556 0.02828947 0.03333334
 0.95723683 0.19583334 0.02828947 0.02777778 0.95723683 0.77083331
 0.02697368 0.02916667 0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 3, "action_description": "Describe what the action means if needed", "coordinates_touch": [-1.0, -1.0], "coordinates_lift": [-1.0, -1.0], "text_input": ["amazon.com"]}