Core dimension: Perception

category: Physical Scene Perception
task_mechanisms: category: Obstacle Detection
items: id: 1
cases: A man is on a park pathway with a prominent stone resting on the ground ahead. He desires to proceed forward safely. He notices the stone in his path, and believes that the route ahead contains a hazard. Fixed camera.

A man is on a park pathway with a prominent stone resting on the ground ahead. He desires to proceed forward safely. He overlooks the stone in his path, and believes that the route ahead remains entirely clear. Fixed camera.

id: 2
cases: A man is taking a walk on a paved pathway in a park with a yellow banana peel resting directly in his path. He desires a safe walk, carefully observes the ground ahead of him, and believes that a slippery obstacle lies on his route. Fixed camera.

A man is taking a walk on a paved pathway in a park with a yellow banana peel resting directly in his path. He desires a safe walk, absentmindedly observes the distant sky above him, and believes that a clear surface lies on his route. Fixed camera.

id: 3
cases: A pedestrian is on a sidewalk with a temporary fence ahead. The pedestrian desires to walk to the destination. The pedestrian visually perceives the temporary fence, and believes that the direct path is blocked. Fixed camera.

A pedestrian is on a sidewalk with a temporary fence ahead. The pedestrian desires to walk to the destination. The pedestrian visually perceives the smartphone screen, and believes that the direct path is clear. Fixed camera.

id: 4
cases: A man is walking on a city sidewalk with a construction barricade ahead. He clearly perceives the barricade on the path, desires to continue walking forward, and believes that his direct path is currently blocked. Fixed camera.

A man is walking on a city sidewalk with a construction barricade ahead. He completely overlooks the barricade on the path, desires to continue walking forward, and believes that his direct path is completely clear. Fixed camera.

id: 5
cases: A student is standing in a library aisle holding a stack of books, with a low bookshelf protruding into the path ahead. The student desires to bring the books to the empty study desk at the end of the aisle. The student perceives the protruding corner of the low bookshelf on the ground and believes that the direct walking path is blocked by the object. Fixed camera.

A student is standing in a library aisle holding a stack of books, with a low bookshelf protruding into the path ahead. The student desires to bring the books to the empty study desk at the end of the aisle. The student misses the protruding corner of the low bookshelf on the ground and believes that the direct walking path is clear of any object. Fixed camera.

id: 6
cases: A fallen small tree lies across the ascending mountain trail. The hiker strongly desires to continue climbing the mountain. The hiker clearly sees the fallen tree on the path and believes that the obstacle necessitates an immediate physical adjustment. Fixed camera.

A fallen small tree lies across the ascending mountain trail. The hiker strongly desires to continue climbing the mountain. The hiker completely overlooks the fallen tree on the path and believes that the route guarantees a safe continuous progression. Fixed camera.

id: 7
cases: A tall man stands in an office facing a meeting room doorway that is shorter than his height. He desires to enter the room smoothly, notices the low clearance of the doorway, and believes the physical space requires careful spatial accommodation. Fixed camera.

A tall man stands in an office facing a meeting room doorway that is shorter than his height. He desires to enter the room smoothly, overlooks the low clearance of the doorway, and believes the physical space allows normal upright progression. Fixed camera.

id: 8
cases: A student is on a campus pathway holding an open book. A garden hose ahead is spraying a curtain of water across the road. The student desires to walk to the teaching building. The student is attentive to the environment and perceives the water curtain. The student believes that the path straight ahead is covered by splashing water. Fixed camera.

A student is on a campus pathway holding an open book. A garden hose ahead is spraying a curtain of water across the road. The student desires to walk to the teaching building. The student is immersed in the reading and overlooks the water curtain. The student believes that the path straight ahead is clear of any obstacles. Fixed camera.

id: 9
cases: A man carrying a laundry basket walks from the living room towards a perfectly transparent closed glass balcony door. He desires to go out to the balcony to hang the clothes. He perceives the subtle surface reflections and believes that the glass door is currently closed. Fixed camera.

A man carrying a laundry basket walks from the living room towards a perfectly transparent closed glass balcony door. He desires to go out to the balcony to hang the clothes. He perceives the clear outside scenery and believes that the glass door is currently open. Fixed camera.

id: 10
cases: A cyclist is riding down a sloping road with a distinct pothole directly ahead in their path. The cyclist clearly perceives the pothole on the asphalt, desires to travel safely down the hill, and believes that the route ahead is currently hazardous. Fixed camera.

A cyclist is riding down a sloping road with a distinct pothole directly ahead in their path. The cyclist entirely overlooks the pothole on the asphalt, desires to travel safely down the hill, and believes that the route ahead is perfectly clear. Fixed camera.

id: 11
cases: A pedestrian is walking quickly on a city sidewalk on a rainy day with a large puddle directly ahead. The pedestrian successfully perceives the puddle on the ground, desires to keep their shoes perfectly dry, and believes that the direct path ahead is covered with water. Fixed camera.

A pedestrian is walking quickly on a city sidewalk on a rainy day with a large puddle directly ahead. The pedestrian completely overlooks the puddle on the ground, desires to keep their shoes perfectly dry, and believes that the direct path ahead is clear of water. Fixed camera.

id: 12
cases: A man in a red cap and blue overalls is running along a brick path where a deep pit lies ahead. He strongly desires to continue his forward progress, clearly sees the deep pit in his path, and believes that the surface ahead is dangerously broken. Fixed camera.

A man in a red cap and blue overalls is running along a brick path where a deep pit lies ahead. He strongly desires to continue his forward progress, completely misses the deep pit in his path, and believes that the surface ahead is perfectly solid. Fixed camera.

category: Target Search
items: id: 1
cases: A customer stands in a supermarket aisle facing a shelf of various drinks, desires to buy a bottle of cola, believes that the shelf contains multiple beverage options, and perceives the cola bottle among the items. Fixed camera.

A customer stands in a supermarket aisle facing a shelf of various drinks, desires to buy a bottle of cola, believes that the shelf contains multiple beverage options, and does not perceive the cola bottle among the items. Fixed camera.

id: 2
cases: A person sits at a desk in a study with a red pen on the corner, desiring to sign a document with a red pen. The person clearly notices the red pen on the desk and believes that the tool is ready for use. Fixed camera.

A person sits at a desk in a study with a red pen on the corner, desiring to sign a document with a red pen. The person completely misses the red pen on the desk and believes that the tool is missing from sight. Fixed camera.

id: 3
cases: A box of chalk rests on the desk in the classroom. The teacher desires to write on the blackboard, and successfully perceives the chalk box on the desk. Fixed camera.

A box of chalk rests on the desk in the classroom. The teacher desires to write on the blackboard, and completely overlooks the chalk box on the desk. Fixed camera.

id: 4
cases: A person stands in a living room with slippers under a sofa. The person strongly desires to put on slippers, and clearly sees the slippers resting underneath the sofa. Fixed camera.

A person stands in a living room with slippers under a sofa. The person strongly desires to put on slippers, and currently cannot see any slippers anywhere in the room. Fixed camera.

id: 5
cases: A man stands before a library bookshelf containing a thick hardcover science book. He desires to borrow this specific book. He clearly perceives the book resting on the shelf directly in front of him. He believes that the book is immediately accessible right there. Fixed camera.

A man stands before a library bookshelf containing a thick hardcover science book. He desires to borrow this specific book. He entirely overlooks the book resting on the shelf directly in front of him. He believes that the book is misplaced somewhere around there. Fixed camera.

id: 6
cases: A walker stands near a park bench with a wallet lying underneath it. The walker desires to locate their missing wallet, notices the visible wallet on the ground, and believes that their lost item is right in front of them. Fixed camera.

A walker stands near a park bench with a wallet lying underneath it. The walker desires to locate their missing wallet, overlooks the visible wallet on the ground, and believes that their lost item is somewhere far away from them. Fixed camera.

id: 7
cases: Night is falling at the campsite, and a camping lantern sits by the tent entrance. The hiker desires to illuminate the area, clearly notices the lantern next to the tent peg, and believes that the light source is right there on the ground. Fixed camera.

Night is falling at the campsite, and a camping lantern sits by the tent entrance. The hiker desires to illuminate the area, completely misses the lantern in the dim shadows, and believes that the light source is left inside the dark tent. Fixed camera.

id: 8
cases: A straw hat rests on a dirt ridge while a farmer is bending over working in a sunny field. The farmer desires to block the bright sun, perceives the straw hat resting nearby, and believes that this specific hat will provide the needed shade. Fixed camera.

A straw hat rests on a dirt ridge while a farmer is bending over working in a sunny field. The farmer desires to block the bright sun, perceives only the crops right below, and believes that an undiscovered hat will provide the needed shade. Fixed camera.

id: 9
cases: A person stands in a cluttered storage room next to a table with a key resting on it. The person strongly desires to possess the key. The person clearly notices the specific location of the key and believes that the item is placed exactly right there. Fixed camera.

A person stands in a cluttered storage room next to a table with a key resting on it. The person strongly desires to possess the key. The person entirely misses the specific location of the key and believes that the item is hidden somewhere around here. Fixed camera.

id: 10
cases: A worker stands near a tool shelf before entering the construction site, and strongly desires to put on a hard hat. The worker clearly notices the yellow hard hat sitting right on the shelf. Fixed camera.

A worker stands near a tool shelf before entering the construction site, and strongly desires to put on a hard hat. The worker completely overlooks the yellow hard hat sitting right on the shelf. Fixed camera.

id: 11
cases: In a vast grassy plain setting, Link stands near a glowing treasure chest resting on the ground. Link holds a strong desire to acquire hidden loot, and he visually perceives the glowing chest in his surroundings. Fixed camera.

In a vast grassy plain setting, Link stands near a glowing treasure chest resting on the ground. Link holds a strong desire to acquire hidden loot, and he completely overlooks the glowing chest in his surroundings. Fixed camera.

category: State Change Detection
items: id: 1
cases: On a table sit two closed boxes, one on the left and one on the right. Previously, the protagonist placed a small white ball into the left box, and subsequently another person relocated the white ball from the left box into the right box. The protagonist has a strong desire to retrieve the small white ball. The protagonist clearly observes the other person relocating the white ball into the right box, and completely believes that the small white ball is currently located strictly within the right box. Fixed camera.

On a table sit two closed boxes, one on the left and one on the right. Previously, the protagonist placed a small white ball into the left box, and subsequently another person relocated the white ball from the left box into the right box. The protagonist has a strong desire to retrieve the small white ball. The protagonist entirely misses the other person relocating the white ball into the right box, and completely believes that the small white ball is currently located strictly within the left box. Fixed camera.

id: 2
cases: A candy box and a pencil box are placed on a desk. Initially, candy was put into the candy box and pencils were put into the pencil box. Later, someone swapped the items, putting the candy into the pencil box and the pencils into the candy box. The protagonist observes that the items were swapped. The protagonist wants to get the candy and believes that the candy is inside the pencil box. Fixed camera.

A candy box and a pencil box are placed on a desk. Initially, candy was put into the candy box and pencils were put into the pencil box. Later, someone swapped the items, putting the candy into the pencil box and the pencils into the candy box. The protagonist misses that the items were swapped. The protagonist wants to get the candy and believes that the candy is inside the candy box. Fixed camera.

id: 3
cases: Two opaque cups are placed on a table, one on the left and one on the right. Initially, the man placed a key in the left cup, and later another person moved the key to the right cup. The man strongly desires to get the key. He observed the person moving the key to the right cup, and he believes that the key is currently in the right cup. Fixed camera.

Two opaque cups are placed on a table, one on the left and one on the right. Initially, the man placed a key in the left cup, and later another person moved the key to the right cup. The man strongly desires to get the key. He missed the person moving the key to the right cup, and he believes that the key is currently in the left cup. Fixed camera.

id: 4
cases: There are a red book and a blue book on the desk, where a notebook is initially placed under the red book and later moved under the blue book by another person. The man strongly desires to retrieve the notebook. The man clearly notices the notebook being moved from under the red book to under the blue book, and believes that the notebook is under the blue book. Fixed camera.

There are a red book and a blue book on the desk, where a notebook is initially placed under the red book and later moved under the blue book by another person. The man strongly desires to retrieve the notebook. The man entirely misses the notebook being moved from under the red book to under the blue book, and believes that the notebook is under the red book. Fixed camera.

id: 5
cases: There is a stationery box and a candy box on the living room table. An eraser was initially located inside the stationery box, and later it was moved into the candy box by someone else. The man wants to get the eraser, witnesses the eraser being moved into the candy box, and believes that the eraser is currently inside the candy box. Fixed camera.

There is a stationery box and a candy box on the living room table. An eraser was initially located inside the stationery box, and later it was moved into the candy box by someone else. The man wants to get the eraser, overlooks the eraser being moved into the candy box, and believes that the eraser is currently inside the stationery box. Fixed camera.

id: 6
cases: Initially, a piece of fruit is situated inside the large bowl on the counter, and subsequently the fruit is transferred into the small bowl. The main character perfectly observes the fruit being transferred, firmly believes that the fruit is in the small bowl, and strongly desires to have the fruit. Fixed camera.

Initially, a piece of fruit is situated inside the large bowl on the counter, and subsequently the fruit is transferred into the small bowl. The main character completely misses the fruit being transferred, firmly believes that the fruit is in the large bowl, and strongly desires to have the fruit. Fixed camera.

id: 7
cases: A green folder and a yellow folder sit on a bookshelf, where a contract was initially placed inside the green folder before someone else moved it to the yellow folder. The protagonist wants to retrieve his contract, completely observing the moment the contract was moved, and believes that the document is currently located inside the yellow folder. Fixed camera.

A green folder and a yellow folder sit on a bookshelf, where a contract was initially placed inside the green folder before someone else moved it to the yellow folder. The protagonist wants to retrieve his contract, completely missing the moment the contract was moved, and believes that the document is currently located inside the green folder. Fixed camera.

id: 8
cases: 书桌上有高低两个笔筒，钢笔起初位于高笔筒里，随后钢笔的实际位置变更为矮笔筒里。主角观察到钢笔位置发生了变更，主角想获取到这支钢笔，并且相信钢笔正处于矮笔筒里。Fixed camera.

书桌上有高低两个笔筒，钢笔起初位于高笔筒里，随后钢笔的实际位置变更为矮笔筒里。主角未观察到钢笔位置发生了变更，主角想获取到这支钢笔，并且相信钢笔正处于高笔筒里。Fixed camera.

id: 9
cases: A young man placed his earphones in the round box on the nightstand, and later someone moved the earphones into the square box. The man wants to get his earphones, notices the earphones being relocated into the square box, and believes that his earphones are currently inside the square box. Fixed camera.

A young man placed his earphones in the round box on the nightstand, and later someone moved the earphones into the square box. The man wants to get his earphones, misses the earphones being relocated into the square box, and believes that his earphones are currently inside the round box. Fixed camera.

id: 10
cases: On a table sit two trays, one holding cookies and the other holding fruit. Initially, a protagonist places a spoon in the cookie tray, and later another person moves the spoon into the fruit tray. The protagonist clearly sees the spoon moving into the fruit tray, believes the spoon is currently located in the fruit tray, and strongly desires to get the spoon. Fixed camera.

On a table sit two trays, one holding cookies and the other holding fruit. Initially, a protagonist places a spoon in the cookie tray, and later another person moves the spoon into the fruit tray. The protagonist completely misses the spoon moving into the fruit tray, believes the spoon is currently located in the cookie tray, and strongly desires to get the spoon. Fixed camera.

category: Rule Cue Perception
task_mechanisms: category: Conventional Rule Cues
items: id: 1
cases: A man stands at a pedestrian crosswalk with a red traffic light ahead. The man desires to cross the street, clearly perceives the red light signal, and believes that crossing is currently dangerous. Fixed camera.

A man stands at a pedestrian crosswalk with a red traffic light ahead. The man desires to cross the street, completely misses the red light signal, and believes that crossing is currently safe. Fixed camera.

id: 2
cases: A driver is in a car approaching an intersection where the traffic lights are broken and a police officer is making a stop gesture. The driver perceives the police officer's clear hand signal. The driver desires to pass through the intersection safely and believes that the officer's command requires an immediate halt. Fixed camera.

A driver is in a car approaching an intersection where the traffic lights are broken and a police officer is making a stop gesture. The driver perceives the completely unlit traffic light fixture. The driver desires to pass through the intersection safely and believes that the unlit signal allows a forward advance. Fixed camera.

id: 3
cases: A man is standing inside an elevator with a visible 'No Smoking' sign on the wall, feels a strong desire to smoke a cigarette, notices the prohibition sign, and believes that smoking is strictly forbidden here. Fixed camera.

A man is standing inside an elevator with a visible 'No Smoking' sign on the wall, feels a strong desire to smoke a cigarette, overlooks the prohibition sign, and believes that smoking is perfectly allowed here. Fixed camera.

id: 4
cases: A driver is in a fast-moving car on a highway with a construction warning sign present on the side. The driver deeply desires to maintain safe driving conditions and holds the belief that the road ahead is completely clear. The driver visually perceives the construction sign. Fixed camera.

A driver is in a fast-moving car on a highway with a construction warning sign present on the side. The driver deeply desires to maintain safe driving conditions and holds the belief that the road ahead is completely clear. The driver visually overlooks the construction sign. Fixed camera.

id: 5
cases: The man stands in a park featuring a grassy lawn and a warning sign. He harbors a clear desire to cross the park. He accurately perceives the warning sign and believes that the grass is restricted. Fixed camera.

The man stands in a park featuring a grassy lawn and a warning sign. He harbors a clear desire to cross the park. He completely overlooks the warning sign and believes that the grass is accessible. Fixed camera.

id: 6
cases: A man who cannot swim stands at the edge of the deep end of a pool with a swimming ring, where an active rule forbids non-swimmers. He possesses a strong desire to experience swimming in the deep section. He is completely aware of the restriction and believes that he must not enter the deep area. Fixed camera.

A man who cannot swim stands at the edge of the deep end of a pool with a swimming ring, where an active rule forbids non-swimmers. He possesses a strong desire to experience swimming in the deep section. He is completely unaware of the restriction and believes that he may safely enter the deep area. Fixed camera.

id: 7
cases: A tourist is visiting a zoo enclosure with a Do Not Feed sign nearby, strongly desires to feed the animals, firmly believes that it is perfectly fine to throw food to them, and successfully notices the presence of the sign. Fixed camera.

A tourist is visiting a zoo enclosure with a Do Not Feed sign nearby, strongly desires to feed the animals, firmly believes that it is perfectly fine to throw food to them, and completely overlooks the presence of the sign. Fixed camera.

id: 8
cases: The person is at a security checkpoint with a sign instructing to take out liquids separately, desires to pass through the security check quickly, believes that all items can be put into the scanner together, and successfully notices the instructional sign. Fixed camera.

The person is at a security checkpoint with a sign instructing to take out liquids separately, desires to pass through the security check quickly, believes that all items can be put into the scanner together, and completely misses the instructional sign. Fixed camera.

id: 9
cases: A visitor stands in a museum before an exhibit that features a 'No Photography' sign. The visitor desires to take a picture of the display, believes that photography is allowed in the hall, and clearly notices the restriction sign. Fixed camera.

A visitor stands in a museum before an exhibit that features a 'No Photography' sign. The visitor desires to take a picture of the display, believes that photography is allowed in the hall, and completely misses the restriction sign. Fixed camera.

id: 10
cases: The protagonist stands inside a library with people reading nearby, feels the desire to answer an incoming phone call, observes the quiet environment and the warning signs, and believes that answering the call here is highly inappropriate. Fixed camera.

The protagonist stands inside a library with people reading nearby, feels the desire to answer an incoming phone call, overlooks the quiet environment and the warning signs, and believes that answering the call here is entirely appropriate. Fixed camera.

id: 11
cases: A person stands at a public garbage disposal point with a nearby green bin and a further red bin, holding a small battery. The person desires to discard the battery. The person observes the classification labels, and believes that the red bin is the proper receptacle for the battery. Fixed camera.

A person stands at a public garbage disposal point with a nearby green bin and a further red bin, holding a small battery. The person desires to discard the battery. The person overlooks the classification labels, and believes that the green bin is an acceptable receptacle for the battery. Fixed camera.

category: Context-Specific Rule Cues
items: id: 1
cases: A man who is Hindu and accustomed to eating with their hands is dining at a restaurant with food and utensils on the table, and he has a strong habit of eating with his hands. He desires to enjoy his meal. He clearly notices the restaurant table sign prohibiting eating with hands. Fixed camera.

A man who is Hindu and accustomed to eating with their hands is dining at a restaurant with food and utensils on the table, and he has a strong habit of eating with his hands. He desires to enjoy his meal. He entirely misses the restaurant table sign prohibiting eating with hands. Fixed camera.

id: 2
cases: A man stands at the entrance of a house with a shoe rack and slippers nearby, wishing to enter the cozy living room. He notices the indoor slippers and believes that guests are required to take off their shoes. Fixed camera.

A man stands at the entrance of a house with a shoe rack and slippers nearby, wishing to enter the cozy living room. He overlooks the indoor slippers and believes that guests are allowed to keep on their shoes. Fixed camera.

id: 3
cases: A man stands in front of a closed meeting room door with a 'Do Not Disturb' sign on the handle. He desires to find someone inside the room. He notices the sign hanging on the door and believes that entering the room will cause a disruption to the meeting. Fixed camera.

A man stands in front of a closed meeting room door with a 'Do Not Disturb' sign on the handle. He desires to find someone inside the room. He overlooks the sign hanging on the door and believes that entering the room is totally acceptable at this current moment. Fixed camera.

id: 4
cases: A 'No Drones' warning sign stands in a park while a person prepares a drone. The person desires to fly the drone and initially believes that flying is permitted in this area. The person clearly notices the warning sign. Fixed camera.

A 'No Drones' warning sign stands in a park while a person prepares a drone. The person desires to fly the drone and initially believes that flying is permitted in this area. The person entirely overlooks the warning sign. Fixed camera.

id: 5
cases: A user wearing a hat and glasses is sitting in a photo booth preparing to take a photo, with the screen displaying a prompt to remove glasses and hats. The user wants to take a compliant ID photo, initially believes that it is acceptable to wear glasses and a hat for the photo, and carefully notices the prompt on the screen. Fixed camera.

A user wearing a hat and glasses is sitting in a photo booth preparing to take a photo, with the screen displaying a prompt to remove glasses and hats. The user wants to take a compliant ID photo, initially believes that it is acceptable to wear glasses and a hat for the photo, and fails to notice the prompt on the screen. Fixed camera.

id: 6
cases: A visitor admires an exhibit with a warning sign nearby, desires to examine the display closely, initially believes that approaching is allowed, and consciously perceives the warning sign. Fixed camera.

A visitor admires an exhibit with a warning sign nearby, desires to examine the display closely, initially believes that approaching is allowed, and completely overlooks the warning sign. Fixed camera.

id: 7
cases: A protagonist is visiting a private art gallery where a strict no-photography rule is in place. The protagonist has a strong desire to record the beautiful paintings on display. The protagonist clearly notices the no-photography sign on the wall and believes that taking a picture is forbidden. Fixed camera.

A protagonist is visiting a private art gallery where a strict no-photography rule is in place. The protagonist has a strong desire to record the beautiful paintings on display. The protagonist entirely misses the no-photography sign on the wall and believes that taking a picture is permitted. Fixed camera.

id: 8
cases: A quiet exam is currently taking place in the classroom. The protagonist deeply desires to ask the adjacent classmate a specific question, and is completely aware that the teacher strictly prohibits any talking during the test. Fixed camera.

A quiet exam is currently taking place in the classroom. The protagonist deeply desires to ask the adjacent classmate a specific question, and is completely unaware that the teacher strictly prohibits any talking during the test. Fixed camera.

id: 9
cases: A man is at his office desk where a company rule prohibits eating in the workspace. He feels hungry and desires to eat the nearby bag of chips, and he is fully aware of the strict rule against eating in the office. Fixed camera.

A man is at his office desk where a company rule prohibits eating in the workspace. He feels hungry and desires to eat the nearby bag of chips, and he is completely unaware of the strict rule against eating in the office. Fixed camera.

id: 10
cases: The man stands in the corridor. He desires to enter the laboratory to start his work. He notices the safety requirement sign on the door, and believes that wearing the protective equipment is strictly required. Fixed camera.

The man stands in the corridor. He desires to enter the laboratory to start his work. He misses the safety requirement sign on the door, and believes that entering the room directly is completely permitted. Fixed camera.

category: Social Signal Perception
task_mechanisms: category: Directive Social Signals
items: id: 1
cases: The protagonist is in the driver's seat of a moving car near an intersection where a traffic police officer is signaling vehicles to stop. The protagonist desires to proceed forward while following driving regulations, and believes that the officer is directing traffic at the intersection. The protagonist notices the officer's stop gesture. Fixed camera.

The protagonist is in the driver's seat of a moving car near an intersection where a traffic police officer is signaling vehicles to stop. The protagonist desires to proceed forward while following driving regulations, and believes that the officer is directing traffic at the intersection. The protagonist overlooks the officer's stop gesture. Fixed camera.

id: 2
cases: A young man stands at the open doorway inside a crowded elevator, wanting to go upstairs. He notices the sounding overload alarm and flashing display, and believes that the elevator cannot operate until someone steps out. Fixed camera.

A young man stands at the open doorway inside a crowded elevator, wanting to go upstairs. He ignores the sounding overload alarm and flashing display, and believes that the elevator will soon operate without any issues. Fixed camera.

id: 3
cases: Inside an office building, a fire alarm suddenly goes off with a piercing sound and flashing red lights. The worker perceives the loud alarm and the flashing red light. He desires to ensure his personal safety, and believes that the current situation indicates a real fire danger. Fixed camera.

Inside an office building, a fire alarm suddenly goes off with a piercing sound and flashing red lights. The worker misses the loud alarm and the flashing red light. He desires to complete his current work task, and believes that the current environment remains a perfectly safe place. Fixed camera.

id: 4
cases: In a kitchen, a paper tray is currently heating inside a microwave and has caught fire. The protagonist desires to safely prepare the food and believes that the paper tray is entirely safe to use. The protagonist successfully perceives the active flames emerging from the tray inside the microwave. Fixed camera.

In a kitchen, a paper tray is currently heating inside a microwave and has caught fire. The protagonist desires to safely prepare the food and believes that the paper tray is entirely safe to use. The protagonist completely overlooks the active flames emerging from the tray inside the microwave. Fixed camera.

id: 5
cases: The subway train is about to depart and the doors are preparing to close. The young man desires to board the train compartment and believes that the doors are still open wide enough to enter. He clearly hears the continuous warning beeps signaling the closing doors. Fixed camera.

The subway train is about to depart and the doors are preparing to close. The young man desires to board the train compartment and believes that the doors are still open wide enough to enter. He does not notice the continuous warning beeps signaling the closing doors. Fixed camera.

id: 6
cases: The self-study class time is officially up and the dismissal bell is actively ringing in the classroom. The student is aware that he is in a self-study class and eagerly desires to leave the room to play basketball the exact moment class ends. He clearly hears the loud sound of the dismissal bell. Fixed camera.

The self-study class time is officially up and the dismissal bell is actively ringing in the classroom. The student is aware that he is in a self-study class and eagerly desires to leave the room to play basketball the exact moment class ends. He completely misses the loud sound of the dismissal bell. Fixed camera.

id: 7
cases: A protagonist is lying in bed sleeping as the alarm clock begins to ring. The protagonist deeply desires to wake up on time for work and holds the belief that the alarm has not yet rung. The protagonist clearly hears the alarm ringing in the bedroom. Fixed camera.

A protagonist is lying in bed sleeping as the alarm clock begins to ring. The protagonist deeply desires to wake up on time for work and holds the belief that the alarm has not yet rung. The protagonist entirely misses the alarm ringing in the bedroom. Fixed camera.

id: 8
cases: The protagonist rides a bicycle on the street with a rear basket containing groceries while a package falls out making a sound. The protagonist desires to ride safely and protect the goods, believes that the goods are stably placed in the basket, and successfully hears the clashing sound of the fallen package. Fixed camera.

The protagonist rides a bicycle on the street with a rear basket containing groceries while a package falls out making a sound. The protagonist desires to ride safely and protect the goods, believes that the goods are stably placed in the basket, and completely misses the clashing sound of the fallen package. Fixed camera.

id: 9
cases: In a kitchen, the protagonist stands near a pot of food that is overheating and emitting a burning smell. The protagonist smells the burning odor, desires to cook the meal successfully, and believes that the food is currently burning. Fixed camera.

In a kitchen, the protagonist stands near a pot of food that is overheating and emitting a burning smell. The protagonist misses the burning odor, desires to cook the meal successfully, and believes that the food is cooking normally. Fixed camera.

id: 10
cases: 城市内，地震警报系统响起警报声，提醒市民可能发生地震。这名市民清楚地听到了外部的警报声音，内心想要保证自身安全，并且相信地震即将来临且环境危险。Fixed camera.

城市内，地震警报系统响起警报声，提醒市民可能发生地震。这名市民完全没注意到外部的警报声音，内心想要保证自身安全，并且相信目前环境依然稳定且安全。Fixed camera.

category: Joint Attention Cues
items: id: 1
cases: The young man and his friend are eating at a restaurant when the friend suddenly looks to the left with a surprised expression. The young man perceives her reaction, desires to maintain steady communication with his friend, and believes that acknowledging her surprise supports their social connection. Fixed camera.

The young man and his friend are eating at a restaurant when the friend suddenly looks to the left with a surprised expression. The young man overlooks her reaction, desires to maintain steady communication with his friend, and believes that continuing their dinner supports their social connection. Fixed camera.

id: 2
cases: A parent points towards a distant ice cream truck and tells the child holding a toy to look over there. The child notices the parent's words and the pointing gesture. The child desires to interact with the parent. The child believes that following the parent's guidance creates a fun shared experience. Fixed camera.

A parent points towards a distant ice cream truck and tells the child holding a toy to look over there. The child misses the parent's words and the pointing gesture. The child desires to focus on the toy. The child believes that playing with the current toy creates a fun personal experience. Fixed camera.

id: 3
cases: A man is walking in a plaza while looking down at a newspaper, as someone nearby suddenly points to the sky and shouts. The man wants to know what is happening around him, and he clearly perceives the nearby shout and the pointing gesture. Fixed camera.

A man is walking in a plaza while looking down at a newspaper, as someone nearby suddenly points to the sky and shouts. The man wants to know what is happening around him, and he completely misses the nearby shout and the pointing gesture. Fixed camera.

id: 4
cases: A basketball player is holding the ball on the court while a teammate stands nearby with a raised hand. The player notices the teammate with the raised hand, wants to secure a point for the team, and believes that the teammate has a clear shot. Fixed camera.

A basketball player is holding the ball on the court while a teammate stands nearby with a raised hand. The player overlooks the teammate with the raised hand, wants to secure a point for the team, and believes that taking the shot personally is best. Fixed camera.

id: 5
cases: A man is choosing a product at a supermarket when another customer touches his arm and points to the upper shelf. The man feels the touch on his arm and sees the pointing gesture towards the upper shelf. He desires to know what the customer is indicating and believes that the customer has spotted a rare limited-edition item on the top shelf. Fixed camera.

A man is choosing a product at a supermarket when another customer touches his arm and points to the upper shelf. The man feels the touch on his arm and sees the pointing gesture towards the upper shelf. He desires to carefully examine the item currently in his hands and believes that the customer is pointing at a generic advertisement banner on the top shelf. Fixed camera.

id: 6
cases: A man is walking on a street, and a stranger behind him suddenly laughs loudly. The man clearly hears the sudden loud laugh from the stranger. He desires to stay aware of his surroundings and believes that an unusual event is occurring behind him. Fixed camera.

A man is walking on a street, and a stranger behind him suddenly laughs loudly. The man completely misses the sudden loud laugh from the stranger. He desires to stay aware of his surroundings and believes that an ordinary situation is occurring behind him. Fixed camera.

id: 7
cases: A man is sitting at a conference table during a meeting while a coworker sitting next to him lightly kicks his foot under the table. The man notices the subtle kick, wants to participate in the meeting, and believes that the discussion is proceeding normally. Fixed camera.

A man is sitting at a conference table during a meeting while a coworker sitting next to him lightly kicks his foot under the table. The man misses the subtle kick, wants to participate in the meeting, and believes that the discussion is proceeding normally. Fixed camera.

id: 8
cases: Inside a modern meeting room, the boss suddenly taps the table with her finger and stares intently at a specific coworker. The young male employee successfully perceives the boss's sudden gesture, and actively desires to understand the leader's exact intention. Fixed camera.

Inside a modern meeting room, the boss suddenly taps the table with her finger and stares intently at a specific coworker. The young male employee completely overlooks the boss's sudden gesture, and actively desires to understand the leader's exact intention. Fixed camera.

id: 9
cases: A student is walking on a campus path when a classmate alongside them touches their sleeve and points to a nearby bulletin board. The student desires to interact with the classmate, clearly perceives the physical touch and the pointing gesture despite wearing headphones, and believes that the classmate is highlighting something on the board. Fixed camera.

A student is walking on a campus path when a classmate alongside them touches their sleeve and points to a nearby bulletin board. The student desires to interact with the classmate, entirely misses the physical touch and the pointing gesture due to wearing headphones, and believes that the classmate is walking silently without any message. Fixed camera.

id: 10
cases: A commuter at the bus stop shouts that the bus is coming and points down the street. The young man hears the loud shout and clearly notices the pointing commuter. He possesses a strong desire to ensure that he does not miss the bus. Fixed camera.

A commuter at the bus stop shouts that the bus is coming and points down the street. The young man watches the phone screen and completely misses the pointing commuter. He possesses a strong desire to ensure that he does not miss the bus. Fixed camera.

id: 11
cases: The protagonist is at the entrance of a closed area with a stationed security guard. The protagonist desires to access the area and believes that the zone is restricted. The protagonist perceives the security guard's stopping gesture. Fixed camera.

The protagonist is at the entrance of a closed area with a stationed security guard. The protagonist desires to access the area and believes that the zone is restricted. The protagonist overlooks the security guard's stopping gesture. Fixed camera.