openinterx/Ego-ST-bench huggingface dataset:
After having a conversation with someone, get up and walk forward. Then turn left and keep walking forward. Walk to the door and open it to go out. Turn around and have another conversation with someone.
Walk forward, go around the sofa, place the mobile phone on the table in front of the sofa. Then lie on the ground beside the table to do push-ups. Stand up, pick up the remote control, and sit on the sofa on the right side. Then start pressing the buttons on the remote control to control the TV. Finally, get up and walk forward. Put the remote control under the TV. Turn around and step backward to pick up the mobile phone on the table in front of the sofa.
Walk a few steps forward to the door and then push it open to enter. Put the suitcase on the ground after taking it off your hand and then lock the door. First, take off your left shoe and place it on the ground, then take off your right shoe and do the same. Pick up the shoes and place them on the right side of the door. Then lift the suitcase and move forward to the left front. Turn left at the staircase entrance, walk forward, go down the stairs, turn around when you reach the corner of the stairs, and continue going down the stairs. When you reach the next floor, turn right behind and keep going forward. Stop in front of a sofa on your left. Put the suitcase on the sofa and open the zipper of the suitcase. After opening the suitcase, throw all the clothes inside the suitcase to the right of the sofa. Then open the zipper of the inner layer of the suitcase, close it again. Close the suitcase and pull up the zipper. Take the suitcase off and place it on the ground. Pick up the clothes on the sofa and put them back down.
Have a conversation on the sofa. Then stand up, turn right, walk straight ahead to the TV set. Then turn left and walk forward to the balcony. Then turn left again and walk forward, chatting with people while crossing the balcony and reaching the other side of the balcony. Then turn left again and walk forward to the kitchen counter. Pass through the kitchen and the refrigerator. Keep going straight ahead, out of the kitchen, and reach the door of the orange-colored room. Close the door and lock it. Then turn around and walk straight ahead. Turn left at the corridor, take one step forward, turn right to enter the bathroom and exit, then turn around and exit the room. Enter the corridor and keep walking straight ahead. Then turn left ahead and enter the original living room.
Pick up the remote control on the right side table and move one step to the right. Sit on the sofa. Use the remote control to turn on the TV. Control the TV with the remote control and then have a conversation. Look around here and there during this time. Then keep watching TV all the time.
Pick up some of the clothes from the bed and take them to the bedside. Turn right and walk through the corridor. Take a glance back once. Reach the washing machine room door, turn right and enter the washing machine room. Open the right-side washing machine and place the clothes in hand on top of the left-side washing machine. Take the white clothes from the washing machine and put them on the left-side washing machine, then put the clothes on the right-side washing machine above it. Close the left-side washing machine. Open the small box of the left-side washing machine and pour the laundry detergent from the sink into the small box of the left-side washing machine. Close the small box of the washing machine and put the laundry detergent back under the sink. After starting the washing machine, walk out of the washing machine room and turn left.
Open the door in front of the door. Then have a conversation with someone. Turn around and walk forward. Walk to the sofa. Have a conversation with someone. Walk forward to the left front, enter the kitchen, turn right, and keep walking forward. Walk to the refrigerator, open the refrigerator. Take out a canned drink from the refrigerator. Turn right and walk forward, then turn left, return to the sofa and hand the drink out. Then sit on the sofa and have a conversation.
Pick up the remote control on the left side of the sofa. Take it and turn on the TV in front of you. Sit on the sofa. Both remote controls are placed on the table in front of you. Then use the one on the left to control the TV. After putting down the remote control, pick up your mobile phone and play games. During the game, look at the rightmost phone on the table and put it back. Then continue playing with the mobile phone. Finally, put the mobile phone in your hand on the rightmost side of the table. Pick up the original mobile phone.
Walk straight ahead, go around the sofa, and reach the TV set. Pick up the two remote controls below the TV set. Turn around and return to the table beside the sofa. Put the mobile phone on the table, then hold one of the remote controls in one hand. Start to control the TV set. Then put all the two remote controls on the table on the right side. Step to the left. Turn right and sit on the ground. Then lie on the ground and start doing sit-ups. After doing a few, turn your body 180 degrees and continue doing them. Then stand up, turn your back, pick up the two remote controls on the table in front of you and turn off the TV set. Walk to the TV set, put the remote control under the TV set.
I have been lying in bed playing video games.
Stand up from the bed, move forward to the right front. When you reach the door of the washing machine room, turn right and enter the washing machine room. Place your mobile phone on the right washing machine. Squat down and take out all the clothes from the right washing machine. Then close the right washing machine, open it again, close it once more. Pick up the mobile phone on the top of the washing machine and walk out of the washing machine room. Turn left and keep walking straight ahead. Walk back to the original place and put the clothes on the bed. Then repeat the process of picking up the clothes, folding them and putting them together neatly. Then hold one of the black clothes in your hand and walk to the foot of the bed. Take out the black bag from under the footboard. Put the clothes into the bag.
After knocking on the door, the door opened and someone came out. Then I went in, turned around, closed the door and had a conversation with the person. Then I kept walking forward. I crossed between the table and the sofa, sat down on the right side of the sofa. I had a conversation with someone. I took the yellow drink that was handed to me. Then I placed the yellow drink on the table in front of me. And I kept having conversations with the person. Then I opened the drink and drank it.
Open the drawer and take out the black shovel. Turn left and open the second drawer, taking out the round plate. Open the left cabinet one by one, repeat closing, turn left to the countertop to take out the flour, open the packaging, open the drawer and take out the bowl. Turn right and squat down to open the corner cabinet, taking out the red basin. Pour the flour into the red basin. Turn left to open the refrigerator, taking out the milk and eggs. Take out two eggs and put them back in the refrigerator. Take out a box of berries and close the refrigerator. Put the two eggs into the red flour basin. Turn right and throw the eggshells into the trash can in the cabinet. Turn left and wash your hands, pour the milk into the red flour basin. Pull out the first drawer, take out the mixer, mix the flour paste. Add milk again, turn left and put the milk back in the refrigerator. Open the refrigerator and take out the food. Open the cabinet to take out the frying pan. Adjust the heat level, feel the temperature, turn on the cheese. Turn right and go to the first layer of the cabinet behind to take out the scraper. Go to the countertop to take out the plate. Use the scraper to scrape the cheese onto the frying pan, rotate the cheese to melt it. Put the remaining un-melted cheese back into the cheese box. Take out the black shovel and stir the cheese in the pan. Pour the batter into the frying pan. Use the scraper to scrape off the excess batter, turn right and take out a piece of wood board from the upper cabinet. Place the wood board on the countertop, turn right and open the drawer to take out the knife. Wash the berries, place them on the wood board to cut them. Turn left and use the black shovel to scrape the pancake, take a small piece of cheese with the scraper and put it into the frying pan. Use the black shovel to flip the pancake. Repeat flipping, put the pancake into the plate. Use the scraper to take the small piece of cheese and put it into the frying pan. Adjust the heat level. Use the scraper to rotate the cheese. Pour the batter into the frying pan for heating. Rotate the frying pan, turn right and open the refrigerator. Take out the items and turn right to walk forward, place them on the table. Turn left and go back to the frying pan to check the phone. Use the black shovel to stir the pancake. Wait for the batter to heat up, look up to the right and look out of the window, repeat looking up, put the pancake into the plate, turn right, pick up the berries and put them into the plate. Turn left to turn off the stove. Turn right and go back to the plate to check the phone.
tarting from the left side of the long couch, turn right and pass another small couch, step over a pillow on the floor, and walk to the space between the table and the long couch. Turn left, bend down to pick up the remote control, put it down, then pick up the clothes on the left side of the table. After putting the clothes down, move forward, passing the right side of the small couch, walk to the side of the TV, then turn around, and move forward to the couch. Turn left to tidy the couch pillows, pick up the remote control again, turn left to face the TV, and walk closer to the TV.
Controlling the TV, Put down the remote control. Turn a round and walk to the sofa.
Put down the pilllows on the sofa. Turn right and pick up the clothes on the floor and table. Turn left and put them down inside a bag. Go straight to the fitness equipment and pick up the cloth, turn back to the bag and put the cloth into it. Turn a round and walk to the TV. Lift up the flowerpot.
Turn around and walk towards the coffee table, pick up the blocks, and straighten the flowerpot. Pick up the trash on the floor, walk to the trash can in the right front, and throw the trash away.
Turn right and walk towards the dining room. Straighten the flowerpot on the left, then place the flowerpot on the right on the table. Pick up the dropper on the table, walk back to the kitchen, and put it in the drawer. Turn right back to the dining room, pick up the tool on the table, walk back to the kitchen, and put it in the drawer. Pick up the sock on the floor, walk forward, and put it in the bag on the floor.
Straighten the flowerpot on the table in front of you, turn right and walk towards the trash can to throw away the garbage. Pick up the clothes on the left, turn around, and place them in the bag on the floor. Walk forward towards the coffee table and pick up the items on the floor. Walk forward towards the bag and put the items inside.
Walk forward into the bedroom on the right. Straighten the vase on the left bedside table, then turn right to make the bed. Turn around, straighten the chair by the door, walk left, pick up the hanger on the floor, and then turn around and walk out of the bedroom.
Turn right and walk towards the bedroom, picking up the hanger on the floor along the way and hanging it back in the wardrobe on the right. Turn right, pick up the clothes on the floor, fold them, and place them on the bed. Turn right again, walk to the head of the bed, and put the pillowcase on the pillow.
Walk forward, place the flowerpot from the right side of the bed onto the wall on the left. Turn around, walk to the head of the bed, pick up the flowerpot, and place it back on the wall. Turn back to the head of the bed and adjust the flowerpot. Put the pillowcase on the pillow on the right side of the bed. Turn around and push the chair back in. Then, turn around and put the clothes into the wardrobe. Turn around and walk out of the bedroom. Walk forward to the living room.
Walk left out of the room, and exercise.
Exercise. Then turn right and walk back and forth on the lawn.
Turn right and walk inside the room.
Playing football.
Walk to the right into the living room, fold the rug on the floor and place it in the box on the left, then walk forward to the dining table and organize the blocks.
Walk to the left into the living room, pick up the items on the floor, turn around and put them back in the box. Walk forward to the kitchen, then turn around and walk into another living room, organizing the items on the coffee table and the floor on the left.
Put the knife and fork from the right side into the box on the left, then turn left and walk into the living room to organize the items. Walk forward back to the window, pick up the ribbon, then turn around and walk back to the living room.
Walk to the right into the living room and organize the coffee table. Turn right back to the window and organize the items on the floor. Turn right back into the living room and continue organizing.
Take down the decoration from the window, turn left, walk back to the living room, and place it in the bag on the floor.
Pick up the items on the table, walk forward and turn right to enter the kitchen, continue walking forward and throw the items into the trash can. Walk to the right, pick up the items on the stove, turn around and walk towards the sink, then turn around and put them back in the fridge.
Walk forward to the sink, put the dishes into the dishwasher, turn around, pick up the items from the table behind you, then turn back and put them into the dishwasher.
Throw away the trash, turn around and put the bowl into the dishwasher. Turn around and walk forward, pull open the cabinet door, then turn around and walk back into the pantry. Walk out and return to the living room.
Turn right into the living room, fold the mat on the floor, and put it into the box.
Turn around and walk towards the sofa, pick up the balloons on the floor and the sofa, turn left into the dining room, and walk straight to the trash can to throw them away.
Walk forward and pick up the items from the sofa. Turn around and walk towards the fireplace, then place the box down.
Lift the sofa and walk to the right front, placing it by the wall. Then turn left and walk towards the sofa. Pick up the plate from the sofa, turn around, and place it back by the wall. Turn left again to return to the opposite side, then turn around and walk back to the wall. Turn right, then walk forward towards the dining room.
Organize the items on the table, walk to the left, pick up the chair, then turn right and move the chair to the table. Turn right again and walk to the door.
Measure the size of the door, then turn left and walk forward to the kitchen to measure its size. Turn left again and measure the size of the glass behind.
Measure the window size. Turn around and walk backward to measure the size of the living room window. Turn right, then turn right again to go upstairs, turn left into the study, and measure the size of the window in front of you.
Take the blanket from the left TV cabinet and spread it on the bed on the right.
Walk forward, turn left to exit the room, walk straight into the bedroom, turn right into the bathroom, turn off the light, then turn around and exit the bedroom, walk straight down the hallway, turn left and go downstairs. Turn left into the dining room.
Walk forward, put the paper into the bag by the wall. Turn around and walk toward the sofa, pick up the items on the sofa and the floor. Turn left and walk toward the kitchen.
Walk forward to the end, turn left and walk to the end, take the decoration off the window, turn around and walk back, then turn right and walk forward to throw it into the kitchen trash can. Take the decoration off the left wall, turn around and throw it into the trash can.
Walk forward and turn right, take someone else's plate, turn around and place it behind you. Walk to the right, take a tissue, then turn around and walk back.
Drink water, then walk to the right and put it in the dishwasher. Turn around, walk to the left, take the plate out of the microwave, and turn around to place it on the table behind.
Tidy up the dining table, turn right and walk forward, then grab a tissue and turn around to walk back. Wipe the table, then turn right and walk forward to wipe the table in front.
Turn right, then left, walk to the stairs, remove the decoration, turn around and walk back to the sofa. Then turn right and walk to the window, remove the balloon.
Pick up the balloon, turn left and walk forward, put it into the box. Turn around and go back to the sofa, pick up the pump, turn left and put it back in the basket. Turn left and walk forward to the window, pick up the balloon.
Walk forward, turn right and go upstairs, walk forward, lift the sofa, turn left and place it on the left. Then turn around, lift the coffee table, and walk to the right to change direction.
Turn right and walk into the kitchen, then turn around and walk left to the stairs, turn left and walk forward, turn left into the bedroom, then turn around and walk out. Walk forward, turn left down the stairs, turn right and walk straight to enter the bedroom, then turn around and walk out, turn left and go upstairs.
Go upstairs, turn left, enter the living room, sit down, crawl to the opposite sofa, turn around, and sit down.
Turn around, walk to the left rear until the end, enter the bedroom, then turn around and come out. Enter the opposite bedroom, then turn around and come out. Turn right, walk straight ahead, turn left to go downstairs. Turn right to enter the bathroom, then come out. Turn left to enter the bedroom, then turn around and come out.
Turn left to walk towards the sofa, fold the blanket on the sofa and put it back. Turn left, lift the sofa, then turn left again and place it in front of the table. Turn right, lift the coffee table, and change direction.
Walk forward towards the table and arrange the items. Then walk forward to the dining table, pick up the box and pear, turn left and place them on the trolley. Walk forward and push the trolley next to the table, turn right, pick up the stool from the floor. Turn back and place it next to the fridge. Turn right, then turn around and walk to the sofa, pick up the tablet, and turn back to walk towards the kitchen.
Walk forward, then turn left and walk to the door. Pick up the shovel from the trolley, turn around and place it back on the table. Walk right to the living room, pick up the shovel and plate, turn around and walk back to the dining room, and place them on the table. Then pick up the house model, walk right to the living room, and place it on the coffee table. Turn around and return to the kitchen.
Walk counterclockwise around the dining table, pick up the dinosaur from the table, and walk to the living room. Place it on the coffee table. Walk counterclockwise halfway around the coffee table, pick up the plate, and walk forward to the dining room to place it on the dining table. Walk forward to the kitchen table and put the kitchenware in place. Then walk right to the living room. Pick up the toys from the table, turn around, and walk back to the dining room. Turn left and return to the kitchen.
Turn left and left again, walk to the door, and pick up the basin from the cart. Turn around and walk back to the dining room, placing it on the table. Pick up the fruit from the table and walk forward to the living room, placing it on the coffee table. Turn left and walk to the dining table to pick up the cutting board. Turn left again and walk back to the kitchen, placing it on the countertop. Turn around and return to the living room, push the cart to the dining table, and put the items down. Then push it back to the kitchen.
Walk forward to the living room, pick up the kitchenware, turn around, and walk back to the kitchen, placing it on the table. Pick up a book and walk to the living room, then turn left to the dining table, pick up the tablet, and turn around to walk back to the living room, placing it on the coffee table. Pick up the storage box, turn right, and walk forward to the kitchen. Place the kitchenware into the box. Turn right and walk to the living room, pick up the storage box, turn left, and place it on the dining table, then turn left again and return to the kitchen.
Walk forward to the dining table, pick up the fruit with your left hand, and turn right to walk to the living room. Pick up the fruit from the coffee table, turn right, and walk back to the kitchen, placing it on the table. Turn around and walk back to the dining table to organize the items. Turn right and walk to the living room, pick up the plate, and turn around to walk back to the dining table. Turn around again, walk to the living room, pick up the dinosaur, turn left, and place it at the door. Turn right and walk back to the kitchen.
Pick up the dinosaur with your right hand, walk forward, and place it at the door. Turn left to tidy up the chair, then turn right to walk back to the living room and organize the items. Then, turn right and walk back to the dining table, placing the box on the left side of the cart. Push the cart forward and return to the kitchen.
Turn left and walk to the door, pick up the fruit, then turn around and walk back to the kitchen. Turn again and walk towards the living room, place the tablet on the coffee table, pick up the box, turn right and walk back to the kitchen, placing it against the wall. After that, turn left and walk back to the living room, pick up the cake, then turn and walk back to the kitchen, placing it on the right side of the dining table. Next, pick up the book from the dining table, turn left and walk back to the living room. Pick up the dinosaur, turn around and walk to the door, place it down, then turn left and walk back to the kitchen.
Walk forward to the dining table, pick up the donut on the left side, and place it on the right side of the table. Pick up the orange on the right side, turn left and walk back to the kitchen, placing it on the table. Then, turn right and walk to the dining table, pick up the plate, turn left and walk towards the living room, pick up the fruit, then turn right and walk to the kitchen.
Walk forward, arrange the chairs. Pick up the frisbee on the left, turn left and walk to the living room to put it down. Pick up the plate, turn left and walk back to the dining table, pick up the knife, turn right and walk to the door, pick up the basin, turn and walk back to the kitchen to put it down. Walk forward to the dining table, pick up the box, turn left and walk back to the kitchen.
Walk straight and turn left, pick up the plate at the door, turn right and walk to the living room, then turn right and walk back to the dining table to put it down. Turn back and walk to the living room, pick up the donut, turn and place it back on the dining table, then push the cart on the left back to the kitchen. Turn right and walk to the dining table, pick up the dinosaur, turn left and walk back to the living room, then turn back to the kitchen to put it down.
Walk towards the dining table, pick up the donut, and place it back on the table. Move to the left side, pick up the banana, then walk towards the stairs and head upstairs. Return down the stairs and walk to the right side of the table to pick up the plate with a sandwich. Walk towards the kitchen or another designated area to place the plate down.
Walk towards the kitchen counter, pick up a piece of fruit, then walk towards the dining table and place it there. Walk to the trash can, dispose of an item, then turn around and walk back to the kitchen. Pick up something from the counter and walk back towards the dining table to place it down.