openinterx/Ego-ST-bench huggingface dataset:
Walk straight for a few steps, pick up the cactus, observe it for a moment, put it down and return to the starting point.
Straighten up a few steps, pick up the water bottle, observe for a moment, put it down, and return to the starting point.
Straighten up a few steps and pick up the light green water bottle and observe it for a moment, then put it down and return to the starting point.
Walk a few steps straight ahead pick up the dinosaur toy and observe it for a moment, put it down and return to the starting point
Walk straight ahead a few steps pick up the black water glass and observe for a moment, put it down and return to the starting point
Walk a few steps straight ahead pick up the alarm clock and observe it for a moment, put it down and return to the starting point
Go straight ahead a few steps pick up the light green water bottle and observe for a moment, put it down and return to the starting point
Go straight ahead a few steps pick up the toy birdhouse and observe it for a moment, put it down and return to the starting point
Walk straight for a few steps pick up the black water glass and observe for a moment, put it down and return to the starting point
Walk straight ahead a few steps pick up the black bowl and observe for a moment, put it down and return to the starting point
Walk a few steps straight ahead pick up the crate and observe for a moment, drop the crate and return to the starting point
Walk a few steps straight ahead pick up the wooden spoon and observe for a moment, put it down and return to the starting point
Walk a few steps straight ahead pick up the deep learning book and observe for a moment, put down the deep learning book and return to the starting point
Walk a few steps straight ahead pick up the board and observe for a moment, drop the board and return to the starting point
Go straight ahead a few steps pick up the black plate and observe for a moment, put down the black plate and return to the starting point
Walk straight for a few steps, pick up the bamboo tray and observe it for a moment, put it down and return to the starting point
Walk straight for a few steps pick up the bamboo tray and observe it for a moment, put it down and return to the starting point
Walk a few steps straight ahead pick up the wooden bowl and observe it for a moment, put it down and return to the starting point
Walk a few steps straight ahead pick up the cactus and observe it for a moment, put it down and return to the starting point
Talk to your companion then stand up and turn left to reach the yellow table to fiddle with the tomato molds, the alarm clock, then back up and return to the starting point
turn right to reach table, turn left to return near start, turn right to reach table, fiddle with table items, turn left to return to start
Wash dishes at sink turn around and take to companion, pick up two black dinner plates on yellow table turn around and wash them, turn left a few steps then right one step then right two steps to reach black dining table, put down black dinner plates, turn right and go back to start
clean black bowl, turn around and hand to partner, pick up yellow board and clean it turn around and put it down, pick up black plate and clean it turn around and put it down, pick up and clean it turn around and put it down, turn right and go back to start
Take a few steps back to reach the yellow table eat the cereal, drink the juice, pick up the dinner plate with the fruit take a few steps right then one step left to reach the black table put down the fruit and plate, turn backward to return to the start
Advance a few steps to reach the black table pick up the wooden bowl turn right then left to the yellow table make a salad pick up the banana and pear turn around to reach the black table turn left then right back to the start
Turn right to reach the yellow table to interact with your friend, turn left to return to the starting point after facing the yellow table
Go back a few steps turn right then left to reach black table, turn left pick up water bottle turn right and put in black table wooden bowl, turn left pick up cereal turn right and put in black table wooden bowl, pick up yellow table wooden fork and put on black table, pick up water bottle and water glass and drink, turn backward to return to starting point
Back up to the black table, eat the fruit, pick up the item and turn left to place it on the yellow table turn right to the black table and turn left to go back to the start
Go backwards to the black table to finish cutting the cake, turn backwards to the black table, put down the plate, turn backwards to the yellow plate, turn left to go back to the start
Back up and then turn left to reach the yellow table, start cooking, then turn left one step and then right to return to the start
Turn back a few steps to reach the yellow table, turn right to cut the fruit and talk to your companion, then turn left to return to the starting point
Walk towards the black table and turn in place between the yellow table, turn left and turn left again to reach the yellow table,
Turn right to reach the yellow table to pick up the black bowl, front right to reach the coffee table to put down the black bowl, turn backward to return to the yellow table, cut the fruit, turn right and then left to reach the black table, turn left to dye across the yellow table to return to the starting point
Walk backward to reach yellow table, pick up water bottle and pour water to drink, wander in place, turn around and return to starting point after handing black table items to companion
Walk towards the black table and turn in place between the yellow table, turn left and turn left again to reach the yellow table
walk towards the yellow table to interact with peers to cook and then return to the starting point
turn back to reach black table, sit down for a drink, pick up cup turn back to reach black coffee table put down cup, turn back to return to black table, turn left at yellow table take cup and put it on the black table, play with tablet and read a book then turn around and go back to the start
Turn backward to black dining table, read book and play with tablet, pour water to drink, pick cup up and turn around to black coffee table to put cup down, turn around and return to black dining table then turn left to return to starting point
Reach backward to black dining table, play with tablet and read book, get up and turn left to set yellow dining table items, turn right to return to black dining table, pick up book and tablet and turn forward to black coffee table put down book and tablet and turn back to black dining table after which turn left to return to starting point
Walk to the black table, turn left a few steps and then right to reach the yellow table, put down the fruit, pick up the plate and turn right and then left to return to the black table, put down the green fruit, turn around and go back to the start
Turn left to reach the yellow table then talk to your friend, fiddle with the turn items, turn left and right then right to reach the sink, start to take the plate from your friend and wash the dishes, turn right and left again to reach the black table to eat, after that return to the starting point
Advance to the black table, turn right and left then right again to reach the yellow table for cleaning items, after that turn left and right again to reach the black table to put down the plates and finally return to the starting point
Reach backward to black dining table, play with tablet and read book, get up and turn left to set yellow dining table items, turn right to go back to black dining table, pick up book and tablet and turn forward to black coffee table put down book and tablet and turn back to black dining table after that turn left to go back to the start
Advance a few steps then turn right to reach the black table, play with the tablet, pick up the water glass and turn left to set it down at the yellow table, turn right to return to the black table, turn backward toward the black coffee table, and afterward walk straight back to the starting point
Walk straight to the black table pick up the wooden plate, turn around and walk to the sink to clean it and pick up the yellow table items to clean them, after that turn left and then right to place them on the black table, return to the yellow table pick up the kettle to the sink to clean it, pick up the yellow table black molds and the kettle and place them on the black table, return to the yellow table again to pick up the plate and observe it, put it down and walk straight back to the Starting Point
Turn backward, then right to reach the yellow table, work with your partner to cook, then turn right and then left to return to the starting point
Walk to the yellow table pick up the cereal and place it in front of the black table and pick up the plate and fruit from the black table turn around and place it on the black coffee table, turn left and then right to return to the starting point
Reach the sink to clean the wooden bowl, after that take the bowl to the yellow table, have a drink, then walk towards the black table, then return to the sink and start cleaning the items, after that turn left and then right to return to the black table to eat, and finally walk straight back to the starting point
Turn left and walk to the yellow table, then go around to the other side pick up the wooden spoon turn right and walk towards the black table turn right again and walk towards the black coffee table, keep watching the wooden spoon, put it down, go around the coffee table once and then pick up the wooden spoon and put it back on the black table and walk straight back to the starting point
walk past the yellow table to the black coffee table and sit on the couch to eat, then turn right to the yellow table to eat a banana and soak cereal, turn left to the black table to pour and drink water, put the kettle back on the yellow table, and return to the starting point afterwards
Turn left to reach the yellow table, eat the cereal, put the black bowl back on the black table, go around the yellow table and back to the other side
Turn right to the black table, talk to a friend for a drink, pick up a sandwich and go back to the yellow table and cut the fruit then turn right to return to the start
From the starting point go to the yellow table, eat the food, turn backward to reach the black table, turn right a few more steps and then turn right back to the starting point
walk past the yellow table to the black coffee table and sit on the couch to eat, put the kettle back on the yellow table, turn right again to the yellow table to eat a banana and soak your cereal, turn left to the black table to pour and drink, and after that go back to the start
Walk to sink to clean plates, place on black table, make a circle to yellow table, walk to black table for drinks, turn right a few steps and then left to return to sink to clean plates, return to black table the same way, and finally turn left to return to starting point
Walk straight to the black coffee table and sit on the couch, play with the tablet and drink water, put the tablet and the water glass back on the black table and the yellow table respectively, go back to the black table and sit down and play with the tablet, and after that go around the yellow table and back to the starting point
Turn right to reach the yellow table and talk to your companion, pick up the cake and go around the yellow table to reach the black table put down the cake and return to the yellow table, eat the fruit, talk to your friend and return to the start
walk straight to black coffee table sit on couch talk to friend pick up water glass on black coffee table drink water get up turn right to black dining table pick up fruit turn left turn right again to yellow dining table cut fruit and talk to companion after that turn left return to starting point
Turn right at yellow table to talk to friend and eat fruit, walk straight to black coffee table to sit on couch and watch flat screen, return to black table to talk to companion, and finally walk straight back to starting point
Turn right at yellow table to talk to friend and eat fruit, walk straight towards black coffee table to sit on couch and watch flat screen, return to black table to talk to companion, and finally walk straight back to starting point
walk around the yellow dining table to the black coffee table to sit down and play with the tablet and read a book, walk to the yellow dining table to pour water and drink, then then the black coffee table to sit on the couch to read a book and play with the tablet, and finally walk straight back to the starting point
Wash wooden bowl in sink, walk around yellow table to other side, cook, put wooden spoon, mold back on black table, turn around and put wooden bowl and cup back on black table, and finally walk straight back to starting point
Turn left right then right again to reach the sink, start to take the plate from your friend and wash the dishes, turn left to reach the yellow table then talk to your friend, fiddle with the turn item, turn right then left to reach the black table to eat, after that return to the starting point
walk straight towards black coffee table sit on couch and watch flat screen, return to black dining table and talk to companion, turn right at yellow dining table and talk to friend and eat fruit, finally walk straight back to starting point
walk past the yellow table to the black coffee table and sit on the couch to eat, turn left to the black table to pour water and drink, turn right again to the yellow table to eat a banana, soak cereal, put the water bottle back on the yellow table, and after that return to the starting point
walk straight to the black table to talk to your friend about drinking and eating, turn around to the yellow table to talk to your friend about drinking and eating at the far corner, and finally walk around the yellow table to go straight back to the start
Walk towards the black table and turn in place between the yellow table, turn left and turn left again to reach the yellow table to place the items on the table and return to the starting point
Turn left to the black table to pour and drink water, pass by the yellow table to walk to the black coffee table and sit on the couch to eat, turn right again to the yellow table to eat a banana, make cereal, put the kettle back on the yellow table, and after that return to the starting point
walk straight towards the black table pour and drink water return to the black coffee table pick up the wooden bowl and water glass return to the black table, go around the yellow table to the other side, put down the water glass turn around and place the wooden bowl on the yellow table, then take away the plate and wooden spoon from the take away the plate and wooden spoon and place it on the yellow table, start cooking, return straight to the start
Turn left a few steps and then right to reach the yellow table, put down the fruit, walk to the black table, pick up the plate and turn right and then left to return to the black table, put down the green fruit, turn around and go back to the start
turn right to the yellow table pour and drink water return to the black coffee table pick up the wooden bowl and glass of water return to the black table, put down the glass of water turn around and place the wooden bowl on the black table, go around the yellow table to the other side, then from take away the plate and the wooden spoon and place it on the yellow table, start cooking and return straight to the start
walk straight to the couch by the black coffee table and sit down, talk to a friend, go back to the yellow table and pick up a knife to go to the black table cake, then go back to the yellow table and put down the knife, turn around and go back behind the black table, and finally walk straight back to the start
talk to friend, go back to yellow table pick up knife go to black table cake, then go back to yellow table put knife down, turn around and go back to black table then walk straight to black coffee table couch sit down and finally walk straight back to start
walk around the yellow table to the other side to pour and drink water turn around and go to the black table to sit down and eat cake, turn left and walk towards the couch by the black coffee table to sit down and talk to a friend and drink water, and finally walk straight back to the start
Turn left to reach between the yellow and black tables take the wooden bowl from your friend and stir it, go to the other side of the yellow table and adjust the alarm clock, pick up the food from the black table and hand it to your friend, talk to your friend and then turn right to return to the starting point
walk towards the yellow table pick up the bowl and spoon walk to the black coffee table couch sit down and start eating then pick up the black plate and wooden spoon place the wooden spoon on the yellow table turn around and go back to the black table put down the plate turn left to the closet turn right to the yellow table and put down the toy bird house finally return to the starting point
Walk straight to the black table to talk to your friend about eating cake, get up and turn left to the yellow table, after that turn left and walk near the black coffee table, then walk straight back to the start
walk straight to the black coffee table next to the couch to play with the tablet, turn right to the black dining table, return to the black coffee table couch, turn right again to the black dining table, return to the black coffee table, and finally walk straight back to the start
go around the yellow table to reach the black table to sit down to eat and drink and eat fruit, turn around and return to the yellow table to talk to a friend and eat fruit, turn left and return to the starting point
Walk straight to the black table to talk to your friend about cake, get up and turn left to the yellow table, after that turn left and walk near the black coffee table, then walk straight back to the starting point
Turn left and walk near the black coffee table, get up and turn left to the yellow table, after that walk straight to the black table to talk to your friend and eat cake, then walk straight back to the start
Turn right to the black dining table, walk straight to the black coffee table next to the couch to play with the tablet, return to the black coffee table couch, turn right again to the black dining table, return to the black coffee table, and finally walk straight back to the starting point
walk straight to the black coffee table pick up the green fruit and eat it, talk to your friend, turn right and walk to the yellow table, return to the black coffee table again, return straight to the start
walk straight to the black table to talk to a friend for a drink and food, turn around to the yellow table to talk to a friend for a drink and food at the far corner, and finally walk around the yellow table to go straight back to the start
turn right to black table pick up fruit turn left turn right again to yellow table cut fruit and talk to companion, walk straight to black coffee table sit on sofa and talk to friend, pick up water glass on black table and drink, after that turn left and return to starting point
walk straight to black coffee table sofa and sit down to chat with a friend, get up and turn right, chat with a friend and eat fruit, walk around the yellow dining table and return to the starting point
Walk straight to the black coffee table to chat with a friend, turn left to the yellow table position to talk to a friend for a snack, and finally turn left to return to the starting point
Put the mobile phone in hand back, reach over the green backpack above the front - loading washing machine on the left. Press the button of the front - loading washing machine. Take out the clothes from the front - loading washing machine, then open the top - loading washing machine on the right and put the clothes in.
Turn off the mobile phone. Wipe the table repeatedly. Then put the napkin back on the right - hand side, and then turn on the mobile phone again.
Walk backwards from the room, pick up the plastic bag on the left - hand table. Then talk to the people, open the door and go out, close the door, and put the plastic bag at the door.
First, pick up the canned drink on the right - hand side of the table and then put it down. Subsequently, raise the hand to signal and talk to the people at the door. After putting the hand down, move the left hand to the yellow porcelain bowl. Finally, move the plastic bowl with red slashes on the table.
Turn 6 pages to the right on the book opened on the knee. Finally, after accepting and talking to the person on the right, turn 2 pages to the right again. Then close the book, get up from the sofa, and put the book on the stack of books on the table.
Touch the chess box with the right hand, and then throw the remaining chess pieces on the table into the chess box. Subsequently, pick up the white toilet paper on the right - hand side of the table and wipe the water on the table clean. Pick up the transparent goblet on the table, pour the water in it onto the table. Finally, throw the scattered chess pieces on the table and the chessboard into the chess box.
Open the door and enter from the door. Subsequently, turn left and pass the sofa and the table in the living room. Walk a few steps to the right, then raise the hand to check the watch. After talking to people for a few words, raise the hand to check the watch again.
Open the suitcase. Put the clothes on the left side of the suitcase into the suitcase, and zip up the suitcase. Take the suitcase off the bed, then walk out of the bedroom. Then turn right and walk through the space between the sofa and the wall in the living room. Walk to the door, open the door, and go out.
Open the refrigerator and take out the two boxes of eggs. Close the refrigerator. Turn around and put the two boxes of eggs into the two paper bags on the table. Then put the potato chips on the table into the paper bag. Pick up the two paper bags on the table. After talking to people, turn left, walk out of the room, come to the door, open the door, and go out.
Pick up the chess box from the brown table. Then walk backwards to the chair and sit on it. Take off the cover of the chess box and put it under the chess box. Take some papers in the box to the right - hand side of the box. Then unfold the chessboard and put it on the left - hand side of the box. Pick up the chess pieces in the box and put them on the chessboard and the table. Finally, take one step to the right.
Pick up the book on the table in front, open the book. Turn 3 pages to the right, then turn 3 pages to the left, and close the book. Stand up, take one step to the left, and then walk to the back of the sofa.
Pick up the cup, take a sip of coffee, and then put the cup down. Talk to people. Pick up the cup on the table. Get up and walk backwards past the table. Turn left, walk a few steps, turn left again, and keep walking forward. Put the cup in hand on the table in front. Then turn around. Walk a few steps, turn right, walk a few more steps, and then turn right to the chair next to the table and sit down.
Talk to people in front of the small brown table. Subsequently, get up, turn left, and keep walking. Then move one step to the right. Talk to people. Then pick up the blue water cup on the platform on the right - hand side, put it on the platform on the left - hand side. Pick up the coffee pot on the platform on the left - hand side and pour the coffee in the pot into the blue water cup on the right - hand side of the platform. Then turn around and talk to people.
Put down the mobile phone. Put the clothes on the bed into the black shoulder bag, pick up the mobile phone and browse it. Put down the mobile phone, zip up the black shoulder bag. Take the black shoulder bag off the bed, turn right, and walk out of the room. Keep walking forward to the stairs. Turn right and go upstairs to the corner of the stairs. Turn around backwards and keep going upstairs. Walk diagonally to the right - front until you reach the orange door. Open the door and go out.