Episode ID: 15425493410076825223.934-980.Open Eating list
Step ID: 0
Goal: Open Eating list

Previous Actions:


Current Screen:
UI Annotations Text: ['' '' '^' 'm.facebook.com/home.' 'php?ref=wizard&' 'What are you doing?'
 'Cancel' '' 'Feeling...' 'R' '' 'Celebrating...' '' 'Watching..' 'O0' ''
 'Eating..' '' 'TDrinking..' '' '' 'Attending..' '' 'Traveling to..' ''
 'Listeing to..' '' '' ')' 'Looking for..' '' '' 'Thinking' 'about...' ''
 'L' 'Reading...' '' 'Playing...' '' '' 'Supporting..' '' '' '' '' '' ''
 '']
UI Annotations Types: ['ICON_THREE_DOTS' 'ICON_HOME' 'TEXT' 'TEXT' 'TEXT' 'TEXT' 'TEXT'
 'ICON_V_FORWARD' 'TEXT' 'TEXT' 'ICON_V_FORWARD' 'TEXT' 'ICON_V_FORWARD'
 'TEXT' 'TEXT' 'ICON_V_FORWARD' 'TEXT' 'ICON_V_FORWARD' 'TEXT'
 'ICON_CALENDAR' 'ICON_V_FORWARD' 'TEXT' 'ICON_V_FORWARD' 'TEXT'
 'ICON_HEADSET' 'TEXT' 'ICON_V_FORWARD' 'ICON_MAGNIFYING_GLASS' 'TEXT'
 'TEXT' 'ICON_V_FORWARD' 'ICON_V_FORWARD' 'TEXT' 'TEXT' 'ICON_V_FORWARD'
 'TEXT' 'TEXT' 'ICON_V_FORWARD' 'TEXT' 'ICON_HEART' 'ICON_V_FORWARD'
 'TEXT' 'ICON_V_BACKWARD' 'ICON_NAV_BAR_RECT' 'ICON_NAV_BAR_CIRCLE' '' ''
 '' '']
Positions: [0.03947368 0.92777777 0.0245614  0.01481481 0.04035088 0.03333334
 0.0254386  0.02962963 0.04649123 0.14629629 0.01491228 0.02407407
 0.04824561 0.2        0.0122807  0.33333334 0.04824561 0.53888887
 0.01403509 0.22777778 0.1        0.32777777 0.01842105 0.35370371
 0.1008772  0.03703704 0.01140351 0.09074074 0.15175438 0.94074076
 0.02192982 0.01851852 0.15526316 0.14814815 0.01666667 0.14074074
 0.2114035  0.05       0.02192982 0.02777778 0.21315789 0.94074076
 0.02105263 0.01666667 0.21578947 0.14629629 0.01666667 0.21111111
 0.27543861 0.94074076 0.02017544 0.01666667 0.27894738 0.14629629
 0.01578947 0.17592593 0.27982455 0.03888889 0.01315789 0.07222223
 0.33684212 0.94074076 0.02105263 0.01666667 0.34035087 0.14814815
 0.01666667 0.10555556 0.39736843 0.94074076 0.02192982 0.01851852
 0.40263158 0.0537037  0.01754386 0.24074075 0.45175439 0.05185185
 0.0377193  0.04259259 0.45964912 0.94074076 0.02105263 0.01851852
 0.46315789 0.14629629 0.01666667 0.18148148 0.52105266 0.94074076
 0.02192982 0.01666667 0.522807   0.12037037 0.02368421 0.25
 0.57631576 0.04814815 0.0368421  0.05       0.58333331 0.11851852
 0.0245614  0.25555557 0.58333331 0.94074076 0.02105263 0.01666667
 0.63508773 0.04629629 0.03859649 0.04629629 0.64385962 0.08703703
 0.01929825 0.02222222 0.64385962 0.1388889  0.0245614  0.21296297
 0.64385962 0.94074076 0.02105263 0.01666667 0.70526314 0.94074076
 0.02192982 0.01851852 0.70964915 0.14629629 0.01666667 0.13518518
 0.71052629 0.29444444 0.01315789 0.11666667 0.76754385 0.94074076
 0.02105263 0.01851852 0.76929826 0.04074074 0.02280702 0.06851852
 0.7719298  0.14814815 0.01666667 0.14629629 0.82894737 0.94074076
 0.02192982 0.01851852 0.83333331 0.14814815 0.01666667 0.14259259
 0.87982458 0.06481481 0.0245614  0.02777778 0.89122808 0.94074076
 0.02017544 0.01666667 0.89561403 0.14629629 0.01666667 0.2037037
 0.96052629 0.19259259 0.0245614  0.02592593 0.96052629 0.77222222
 0.0254386  0.02962963 0.96228069 0.48148149 0.02280702 0.02777778
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.         0.         0.
 0.         0.         0.         0.        ]


What should the Android do next?

Action: {"action_type": 4, "action_description": "Describe what the action means if needed", "coordinates_touch": [0.35794875025749207, 0.36402183771133423], "coordinates_lift": [0.35794875025749207, 0.36402183771133423], "text_input": [""]}