openinterx/Ego-ST-bench huggingface dataset:
Walk straight for a few steps, pick up the cactus and observe it for a moment, then put it down and return to the starting point.
Walk a few steps straight ahead, pick up the alarm clock, observe it for a moment, put it down and return to the starting point.
Walk straight for a few steps, pick up the dinosaur toy and observe it for a moment, then put it down and return to the starting point.
Straighten up a few steps, pick up the water bottle, observe for a moment, put it down and return to the starting point.
Straighten up a few steps and pick up the light green water bottle and observe it for a moment, then put it down and return to the starting then put it down and return to the starting point.
cWalk a few steps straight ahead, pick up the toy birdhouse and observe it for a moment, then put it down and return to the starting point .
Walk a few steps straight ahead, pick up the toy birdhouse and observe it for a moment, then put it down and return to the starting point.
Walk straight ahead a few steps and pick up the dinosaur toy to observe it for a moment, put it down and return to the starting point
Walk a few steps straight ahead pick up the cactus ball and observe it for a moment, put it down and return to the starting point
Walk a few steps straight ahead pick up the black water glass and observe it for a moment, put it down and return to the starting point
Walk a few steps straight ahead and pick up the alarm clock and observe it for a moment, put it down and return to the starting point
Go straight ahead a few steps and pick up the light green water bottle and observe it for a few moments, put it down and return to the starting point
Go straight ahead a few steps and pick up the toy birdhouse to observe it for a moment, put it down and return to the starting point
Walk straight ahead a few steps pick up the white water glass and observe for a moment, put it down and return to the starting point
Walk straight for a few steps pick up the fork and observe for a moment, put down the fork and return to the starting point
Walk a few steps straight ahead pick up the black water glass and observe for a moment, put it down and return to the starting point
Walk straight ahead a few steps pick up the black bowl and observe it for a moment, put it down and return to the starting point
Go straight ahead a few steps and pick up the crate and observe it for a moment, then put it down and return to the starting point
Go straight ahead a few steps and pick up the crate and observe it for a moment, put it down and return to the starting point
Walk straight ahead a few steps pick up the wooden spoon and observe for a moment, put it down and return to the starting point
Walk a few steps straight ahead pick up the Deep Learning book and observe for a moment, put down the Deep Learning book and return to the starting point
Walk straight for a few steps pick up the board and observe for a moment, put down the board and return to the starting point
Go straight ahead a few steps pick up the black plate and observe it for a moment, put it down and return to the starting point
Walk straight for a few steps, pick up the bamboo tray and observe it for a moment, then put it down and return to the starting point
Walk straight for a few steps, pick up the bamboo tray and observe it for a moment, put it down and go back to the starting point
Walk straight ahead a few steps pick up the wooden bowl and observe for a moment, put it down and return to the starting point
Walk a few steps straight ahead and pick up the cactus to observe it for a moment, put it down and return to the starting point
Take a few steps forward to the yellow table, fiddle with the alarm clock, tomato molds, and then turn right to the black table to talk to your companion
Turn right to reach the yellow table, set the table, sit and turn to walk near the starting point,, turn right to reach the table, turn left to return to the starting point
Turn left toward black table, sit down and pick up two black dinner plates, get up and turn left two, turn left one more step and then right to reach the sink to rinse the plates, turn and place them on the yellow table, get the wooden bowls and turn to wash the bowls at the sink
Turn left to reach yellow table, take knife and turn to clean it turn to put it back, take black plate and turn to clean it, pick up yellow board and turn to clean it, take black bowl handed to you by companion at yellow table and turn to clean it
Turn backward and walk towards the black table and pick up the plate with the fruit on it, turn right and then left to reach the yellow table, then take a knife from the table and cut off the fruit to make a juice and drink it, make a cereal on the table and eat it and turn around and go back to the starting point
Turn left a few steps and then right to reach the black table, pick up the banana and pear and turn around to return to the yellow table, cut up the fruit, put it in a wooden bowl to make a salad, turn right, then left to reach the black table, put down the wooden bowl, turn around, and take a few steps forward to return to the starting point
Turn left to reach the yellow table and face the table to take the sauce and squeeze it on the cake to interact with your companion and then turn left to return to the starting point
Turn backward to reach between the black table and the table for the song, pick up the kettle and cup for a drink pick up the wooden fork from the black table and turn left to place it on the yellow table, turn left to pick up the cereal and turn right to place it in the wooden bowl from the black table, turn left to pick up the kettle and turn right to place it in the wooden bowl from the black table, turn left and right and then left again to return to the starting point
Turn backward and walk to the black table pick up the item turn left and place it on the yellow table turn right to the black table and eat the fruit, turn left and go back to the starting point
Turn backward to the black table, turn right and right again to the yellow table, pick up the black plate, turn backward and put it on the black table, turn backward to the yellow table, cut the cake, turn right and left to return to the starting point
Turn backward a few steps and then turn right to reach the yellow table and start cooking, after which turn right one step and then left to return to the starting point
Turn left a few steps and turn around to face the yellow table to talk to your companion and then cut the fruit, after which you turn left to return to the starting point
Turn left a few steps to reach the yellow table, place the table items, turn right a few steps to pick up the molds on the floor, turn left to return to the yellow table, turn right a few steps and turn right again to reach the black table, turn around in the same place and return to the starting point
Turn left to reach the yellow table go around the table forward to reach the black table pick up the banana turn left a few steps turn right again to reach the yellow table cut the fruit a few steps forward to the right to reach the coffee table pick up the black bowl turn back a few steps back to the yellow table turn left to return to the starting point
Turn around and head straight ahead to the black table and hand your companion the items on the table and hover in place before picking up the water bottle on the yellow table and pouring a drink before turning left to return to the starting point
Turn left to reach the yellow table and interact with your companion to cook and then go straight back to the start
Turn backward to black table sit down play tablet read deep learning book pick up cup get up turn left put it on yellow table turn left again turn left again turn left a few steps get black cup turn backward return to black table pour water drink water finally turn left return to starting point
Turn backward to black dining table then turn right to black coffee table pick up cup turn back to black dining table, pour water to drink, read book and play with tablet, turn left to return to starting point
Turn backward to the black table then turn right to the black coffee table pick up the tablet and the deep learning book turn around and return to the black table, turn left to set the yellow table items, turn right to return to the black table, read and play with the tablet, and return to the starting point afterwards
Turn backward to black dining table then turn right to black coffee table pick up cup turn around return to black dining table, pour water to drink, read book and play with tablet, turn left to return to starting point
Turn around to reach the black table, pick up the green fruit and turn left a few steps then turn right to reach the yellow table and cut the fruit, turn right and then left again to return to the black table to pick up the black plate, return to the yellow table to fill it with fruit on the same route, then return to the black table and finally turn left to return to the starting point
Backward to the black table, sit down to eat, get up, turn left, turn right, come to the sink to wash dishes, take the dishes from your friend and continue washing, turn right, turn left, turn left again, go back to the yellow table, fiddle with the items on the table, talk to your friend and turn right to go back to the beginning
Move backward to the black table, go over the plate in your friend's hand, dump the trash, turn right to the sink, start washing, wander around the yellow table looking for items to wash, turn left and right to reach the black table and then left again to return to the starting point
Walk straight to the black coffee table to pick up the deep learning book and tablet, turn right to the black dining table to read the book and play with the tablet, turn left to the yellow dining table to get a drink of water, go back to the black dining table to put down the glass of water and play with the tablet, turn right and then left again to go back to the starting point
Walk straight to the black table pick up the wooden plate, turn around and walk to the sink to clean it and pick up the yellow table items to clean them, after that turn left and then right to place them on the black table, return to the yellow table pick up the kettle to the sink to clean it, pick up the yellow table black molds and the kettle and place them on the black table, return to the yellow table again pick up the plate and observe it, put it down and walk straight back to the Starting point
Turn left to the yellow dining table, pick up the kettle and pour water into the wooden bowl to stir and go around to the other side of the table to work with your partner to cook, then turn right and then left again to return to the starting point
Turn left a few steps and then right to reach the black coffee table, eat the fruit on the coffee table, pick up the plate and the orange and turn left to the black table, continue eating, walk in front of the black table to pick up the cereal and put it on the yellow table, and then go back to the starting point
Turn back and walk to the black table, sit down and start eating then turn left then right to the sink to clean plates, turn to the yellow table to pick up items to clean, take the bowl handed to you by your companion to clean, walk straight to the black table with the bowl, set it down and have a drink, return to the yellow table to pick up the wooden bowl and clean it then go back to the starting point
Turn left and walk to the yellow table, then go around to the other side and pick up the wooden spoon and turn right and walk towards the black table, then turn right and walk towards the black coffee table, watch the wooden spoon all the time, put it down, go around the coffee table, then pick up the wooden spoon and put it back on the black table and walk straight back to the starting point
Backward and then right to the yellow table, go around to the other side and pick up the kettle, walk straight to the black table, pour and drink water, turn right to the yellow table and eat bananas, soak cereal, walk straight to the black coffee table and sit on the couch, eat, after that, pass by the yellow table and walk straight back to the starting point
Turn left to reach the yellow table, take the fruit handed to you by your companion and cut it up, put it in the wooden bowl, go around the yellow table to reach the black table pick up the cereal and the black bowl go back to the yellow table stir and eat it turn left and return to the starting point
Turn backward and then right to walk to the yellow table, go around to the other side and pick up the kettle, walk straight to the black table, pour and drink water, turn right to the yellow table to eat a banana, soak cereal, walk straight to the black coffee table to sit on the couch, eat, and afterward pass by the yellow table walk straight back to the starting point
Turn left to the yellow table to cut fruit, take sandwich turn right to the black table to talk to a friend, get a drink of water, turn left to return to the starting point
Turn left to reach the yellow table then left a few more steps then left again to reach the black table, pick up the cereal and turn left to put it on the yellow table, run out = bowl then take the cereal poured by your companion and mix it up, pick up the food at the yellow table and eat it and return to the starting point
Walk straight to the black table pick up the wooden plate, turn around and walk to the sink to clean it and pick up the yellow table items to clean them, after that turn left and then right and put them on the black table, return to the yellow table pick up the kettle to the sink to clean it, pick up the yellow table black molds and the kettle and put them on the black table, return to the yellow table again to pick up the plate and observe it, put it down and walk straight back to the Starting point
Backward and then right to the yellow table, go around to the other side and pick up the water bottle and turn right to the yellow table to eat a banana, make cereal, walk straight to the black coffee table to sit on the couch, eat,, walk straight to the black table, pour water and drink, after that pass by the yellow table and walk straight back to the start
Walk straight to the black table, dump the contents of your plate in the garbage, turn left and walk to the sink for cleaning, pick up the bowl handed to you by your companion for cleaning, walk to the black table for a drink, go around the yellow table, return to the black table to pick up your plate and wash it in the sink, turn left and return to the starting point
Turn left and then left again around the yellow table to get to the black table, clear the table and sit down, play with the tablet, get up and come to the yellow table pick up the cup and try to make it to the black coffee table and put the cup down, return to the black table pick up the tablet and go back to the black table and sit on the couch playing with the tablet and drinking, walk straight back to the starting point
Turn left to the yellow table to talk to your friend, pick up the fruit on the table and eat it, turn right and then left again for a few steps and then turn left to reach the black table to pick up the cake and return to the yellow table to continue the conversation, and then turn left to return to the starting point
Walk straight to the black coffee table sit on the couch and talk to a friend, pick up a glass of water from the black coffee table and drink, get up and turn right to the black dining table pick up the fruit and turn left and right again to the yellow dining table to cut up the fruit and talk to your companion, after which you turn left and return to the starting point
Walk straight to black table to talk to companion, pick up glass of water from table and place it on yellow table to left, turn left and walk to black coffee table, sit on couch and watch flat screen, return to yellow table to talk to companion and eat fruit, turn left and return to starting point
Walked straight to the black coffee table and picked up the deep learning book and tablet to play with, picked up the cup and turned right to return to the yellow table to pour water and drink, returned to the black coffee table again to sit on the couch to read and play with the tablet, and then walked straight back to the starting point bypassing the yellow table
Walk straight to the black table pick up the cups and wooden bowls turn around and put them on the yellow table, go back to the black table pick up the wooden spoons and molds return to the yellow table, cook, go around the yellow table to reach the sink to clean the wooden bowls, and finally return to the starting point
Turn right then left then left again to get back to the yellow table to fiddle with the items on the table and talk to your friend then turn backward to get to the black table to sit down and eat get up turn left then right again to get to the sink to wash the dishes, take the dishes from your friend and continue washing them, turn right to get back to the starting point
Walk straight to the black table pick up the glass of water on the table and put it on the yellow table on the left, turn left and walk to the black coffee table to talk to your companion,, sit on the couch and watch the flat screen, go back to the yellow table to talk to your companion and eat the fruit, turn left and go back to the starting point
Turn left and then left again to go around the yellow table to the black table, clear the table and sit down get up come to the yellow table pick up the cups go left to the black coffee table and put down the cups,, go back to the black table pick up the tablet and play with the tablet, go back to the black coffee table and sit on the couch to play with the tablet and drink, walk straight back to the starting point
Walk straight to the black table, pour water and drink, turn backward and then right to the yellow table,, turn right to the yellow table and eat a banana, go around to the other side and pick up a kettle to make cereal, walk straight to the black coffee table and sit on the couch, eat, after that pass by the yellow table and walk straight back to the starting point
Walked straight to the furthest corner of the yellow table to talk to a friend and drink and eat, turned around to the black table and sat down, ate and talked, drank, and walked straight back to the starting point afterwards
Turn left a few steps to reach the yellow table, turn right a few steps to pick up the molds on the floor, turn left to return to the yellow table, place the items on the table, turn right a few steps and turn right again to reach the black table, turn around in the same place and return to the starting point
Turned right to yellow table ate banana poured water drank water, walked straight to black table, turned right again backward and walked to yellow table,, went around to other side picked up kettle to make cereal, walked straight to black coffee table sat on couch and ate food, after that walked past the yellow table and walked straight back to the start
walk straight towards the black coffee table pick up the wooden bowl and water glass and return to the black table, put down the water glass and turn around and put the wooden bowl on the yellow table, take the plate and wooden spoon from the black table and put it on the yellow table, go around the yellow table to the other side, start to cook, go back to the black table to pour and drink, return straight to the starting point
Turn right and then left back to the black table pick up the black plate, turn around to reach the black table, pick up the green fruit turn left a few steps and then right to reach the yellow table to cut the fruit, return to the yellow table to fill the fruit in the same route, then return to the black table and finally turn left to return to the starting point
Walk straight to the yellow table pick up the wooden bowl and water cup and return to the black table, then take the plate and wooden spoon from the black table and place it on the upper black coffee table, put down the water cup and turn around and place the wooden bowl on the yellow table, go around the yellow table to the other side, start cooking, go back to the black table to pour and drink, return straight to the starting point
Turn around and walk behind the black table, talk to your companion, take the cup and drink, follow your companion straight to the yellow table, turn right and put the cup on the black table,, come to the yellow table and take the knife back to the black table and cut the cake then go back to the yellow table and put it down, come straight to the couch by the black coffee table and sit and talk to your friend, walk straight back to the starting point
Go straight to the black coffee table and sit on the couch and talk to your friend, turn around and walk behind the black table, talk to your companion, take the cup and drink, turn right and put the cup on the black table, follow your companion straight to the yellow table, come to the yellow table and take the knife and go back to the black table and cut the cake then go back to the yellow table and put it down, and walk back to the starting point
Turn left and walk to the sink to talk to your friend, then walk straight to the couch by the black coffee table and sit down, talk to your friend and have a drink, turn right and come to the black dining table, sit down and eat the cake, take a cup to the yellow dining table to pour and drink, walk around the yellow dining table and walk back to the starting point
After talking to friend turn left between yellow and black tables, continue talking, pick up food from black table and hand it to friend, go to other side of yellow table and adjust alarm clock, take wooden bowl from friend and stir it, turn right and return to starting point
Turn left to the yellow table and pick up the toy birdhouse, turn left and then right and put it on the armoire, turn back to the black table and pick up the plate and put it on the yellow table, then pick up the wooden spoon and plate and walk straight to the couch next to the black coffee table and sit down and start eating and then go back to the yellow table and put down the bowl and spoon and walk back to the starting point
Go around the yellow table near the black coffee table, turn right to the black table and pour water to drink, turn left and put the kettle on the yellow table and the glass on the black table, sit on the chair in front of the black table, eat the cake, talk to your friends and go straight back to the starting point
walk straight to black coffee table next to couch sit down set plate on coffee table turn right to black dining room table pick up deep learning book return to black coffee table watch it turn right to black dining room table pick up tablet return to black coffee table sit on couch play with tablet return straight to starting point
Turn left to yellow table cut fruit talk to partner, drink water, turn right then left again sit at black table eat fruit, eat with wooden spoon, drink water, go around yellow table back to starting point
Go around the yellow table near the black coffee table, turn right to the black table and pour water to drink, turn left and put the kettle on the yellow table and the glass on the black table, sit on the chair in front of the black table, eat the cake, talk to your friend and go straight back to the starting point
Turn right to black table, pour water to drink, put water glass on black table, sit on chair in front of black table, eat cake, go around yellow table near black coffee table, turn left and put kettle on yellow table, talk to friend and go straight back to the start point
Turn right to black dining table pick up tablet, return to black coffee table sit on couch play with tablet, walk straight to black coffee table sit down on couch next to black coffee table set plate on coffee table turn right to black dining table pick up deep learning book return to black coffee table watch, return straight to starting point
Walk straight to the black coffee table, turn right and walk to the yellow table, return to the black coffee table again, pick up the green fruit and eat it, talk to your friend, and walk straight back to the start