Patent Description:
Recently, technologies in which content is distributed according to the circumstances of a user have been proposed. Content distribution according to user circumstances is not limited to the circumstances of the user only, and technologies have also been proposed in which the circumstances of people together with the user are also sensed, and content corresponding to the circumstances is distributed to the user and the people together with the user.

For example, in the case where the user is together with family and friends at home, it is possible to select the content to output according to who the user is with, and it is also possible to output lively content according to according to factors such as an overall excitement level of attendees at a concert venue or the like.

More specifically, for example, Patent Document <NUM> below discloses a system that distributes beneficial content according to density and mental state (excited state, calm state, and various emotional states).

Also, Patent Document <NUM> below discloses a system that distributes suitable content according to who is nearby in an area where a plurality of people lives together inside a home.

Also, Patent Document <NUM> below discloses a technology that recognizes an area that is crowded and an area that is not so crowded, and leads a user from the crowded area to the uncrowded area.

<CIT> pertains to a system that detects the positions of various users in line, determines the users' tolerance for waiting in line, and based on the tolerance of the users for waiting in line, rearranges the line positions of the users accordingly. The user's tolerance may be detected by their current position, their current movements and activities, the user's purchase or transaction history, interests and hobbies, past line waiting experience. The system may determine incentives or rewards and may offer them to the users who are waiting in line to incentivize them to stay in line.

When a user is together with trusted friends, fans of the same artist, people with the same interests, or the like, all of the technologies described above support the fostering of positive feelings by presenting predetermined content, but in actual daily life, many strangers coexist in the same space at the same time in many cases.

For example, in crowded places, such as a long line like at a popular shop or a resort, a packed train during rush hour for work and school, or inside an event hall or train station, a user is often harboring negative emotions, but in such cases has no alternative but to wait for the time to pass while enduring the unpleasant conditions.

Accordingly, the present disclosure proposes an information processing system and an information processing method, capable of distributing special content for relieving a user's negative circumstances.

According to a first aspect, the invention provides an information processing system in accordance with independent claim <NUM>. According to a second aspect, the invention provides an information processing method in accordance with independent claim <NUM>. Further aspects of the invention are set forth in the dependent claims.

According to the present disclosure as described above, it becomes possible to distribute special content for relieving a user's negative circumstances.

Hereinafter, a preferred embodiment of the present disclosure will be described in detail with reference to the appended drawings.

Hereinafter, the description will proceed in the following order.

<FIG> is a diagram summarizing an information processing system according to one embodiment of the present disclosure. The information processing system according to the embodiment is capable of distributing special content for relieving a user's negative circumstances.

For example, as illustrated in <FIG>, when people have made a long line and are waiting their turn on the release date for a new video game or the like, it is presumed that the people in line will become bored and experience negative emotions. In this case, if the current system detects that a user is waiting in line and distributes special content to the user, it becomes possible to relieve the user's negative circumstances.

The content to be distributed is content such as images, moving images (video; a drama, a motion picture, anime, a short movie, or the like), augmented reality (AR) images, or music, and may be set by a content business in advance. For example, content related to the line in which people are lined up may be distributed. More specifically, AR display information for a character who appears in the game that the user is lining up for may be distributed, and when the user holds up a user terminal <NUM> such as a tablet as illustrated in <FIG>, an AR image <NUM> of the character may be displayed superimposed onto a real image (a through-the-lens image taken by a camera provided in the user terminal <NUM>). With this arrangement, even in cases where the user is waiting in line and experience negative circumstances, the user is able to watch and enjoy the content without simply waiting for the time to pass.

Thus, according to the embodiment, it becomes possible to distribute special content for relieving a user's negative circumstances.

Next, an overall configuration of such an information processing system according to the embodiment will be described with reference to <FIG> is a diagram illustrating one example of an overall configuration of the information processing system according to the embodiment.

As illustrated in <FIG>, the information processing system according to the embodiment includes the user terminal <NUM>, a server <NUM>, a camera sensor 4A and a people flow sensor 4B which are examples of sensor devices, and content business servers <NUM> (5A to 5C).

The user terminal <NUM> is an information processing terminal used by the user, and is anticipated to be a mobile terminal such as a tablet, a smartphone, a mobile phone, or a laptop personal computer (PC), or a wearable device worn on the user's body (such as an HMD, smart eyeglasses, a smartwatch, a smartband, a smart neckband, a neckband speaker, an earring speaker, or an ear cuff speaker). The user terminal <NUM> communicably connects to the server <NUM> through a network <NUM> to transmit and receive data. For example, the user terminal <NUM> measures the current position and transmits position information to the server <NUM>. Also, the user terminal <NUM> receives content from the server <NUM>, and provides the content to the user.

The server <NUM> controls the distribution of special content according user circumstances. The content to distribute and the conditions for distributing content are preset by the content business servers <NUM> (5A to 5C).

The server <NUM> ascertains crowded locations, locations where a line has formed, and the like on the basis of information such as persons and people count information (that is, the number of people) detected by the camera sensor 4A installed in large numbers in a city and terminal count information detected the people flow sensor similarly installed in large numbers in a city, for example. Subsequently, in the case where the user is in a crowded location according to the position information transmitted from the user terminal <NUM>, for example, because it is anticipated that the user is experiencing negative emotions, the server <NUM> distributes corresponding special content to the crowded zone. In this case, content may be distributed such that only specific users (such as users registered as users of the current system) can receive the content, or such that an unspecified large number of people in the crowded zone can enjoy the content.

The above describes the information processing system according to one embodiment of the present disclosure. Next, a specific configuration of each device included in the information processing system according to the embodiment will be described with reference to the drawings.

<FIG> is a block diagram illustrating one example of a configuration of the user terminal <NUM> according to the embodiment. As illustrated in <FIG>, the user terminal <NUM> includes a control unit <NUM>, a communication unit <NUM>, an input unit <NUM>, a position sensor <NUM>, an output unit <NUM>, and a storage unit <NUM>.

The control unit <NUM> functions as an operation processing unit and a control unit, and controls the entire operation in the user terminal <NUM> according to various kinds of programs. The control unit <NUM> is achieved by an electric circuit such as a central processing unit (CPU) or a microprocessor. Further, the control unit <NUM> may include read only memory (ROM) that stores programs to be used, operation parameters, etc., and random access memory (RAM) that temporarily stores parameters that change appropriately, etc..

In addition, the control unit <NUM> according to the embodiment also functions as a user information management unit <NUM> and a content output control unit <NUM>.

The user information management unit <NUM> manages user information. Specifically, the user information management unit <NUM> acquires and stores a user ID and user preference information in the storage unit <NUM>.

The content output control unit <NUM> controls the output, from the output unit <NUM>, of content received from the server <NUM> by the communication unit <NUM>.

The communication unit <NUM> connects to the network <NUM> in a wired or wireless manner, and transmits or receives data with the server <NUM> over the network. The communication unit <NUM> communicably connects to the network <NUM> by a method such as wired/wireless local area network (LAN), Wi-Fi (registered trademark), or a mobile communication network (long term evolution (LTE), the third generation of mobile telecommunications technology (<NUM>)), for example. The communication unit <NUM> according to the embodiment may continually transmit current position information to the server <NUM>. Also, the communication unit <NUM> according to the embodiment receives content from the server <NUM> when it is determined that the current position is contained inside an unpleasant area.

The input unit <NUM> receives information input from an external source into the user terminal <NUM>. For example, the input unit <NUM> may be an operation input unit that receives operation input by a user, or a sound input unit that collects nearby sound. The operation input unit receives an operation instruction given by the user, and outputs the operation content to the control unit <NUM>. The operation input unit may be a touch sensor, a pressure sensor, or a proximity sensor. Alternatively, the operation input unit may be a physical configuration, such as buttons, switches, and levers. Also, the sound input unit is realized by a microphone, a microphone amplifier unit that performs a process of amplifying a sound signal obtained by the microphone, and an A/D converter that digitally converts the sound signal. The sound signal is output to the control unit <NUM>.

Also, the input unit <NUM> may be any of various types of sensors that acquire user circumstances or surrounding environment information. Specifically, for example, motion sensors (such as an acceleration sensor, a gyro sensor, and a geomagnetic sensor), biological sensors (such as a body temperature sensor, a pulse sensor, a heat rate sensor, a blood pressure sensor, a vein sensor, a perspiration sensor, a respiration sensor, a brain wave sensor, a myoelectric sensor, and a fingerprint sensor), and environmental sensors (such as a temperature sensor, an illuminance sensor, and a humidity sensor) are anticipated.

The position sensor <NUM> includes a function of detecting the current position of the user terminal <NUM> on the basis of an externally acquired signal. Specifically, for example, the position sensor <NUM> is realized by a global positioning system (GPS) positioning unit that receives radio waves from GPS satellites, detects the position where the user terminal <NUM> exists, and outputs the detected position information to the control unit <NUM>. In addition, other than GPS, the position sensor <NUM> may also detect position by a method such as Wi-Fi (registered trademark), Bluetooth (registered trademark), transmitting or receiving information with a mobile phone, PHS, or smartphone, or by short-range communication, for example.

The output unit <NUM> has a function of outputting information to present to the user. For example, the output unit <NUM> may be realized by a sound output unit and a display unit. The sound output unit includes a speaker that reproduces sound signals and an amplifier circuit for the speaker. The display unit is a display device that outputs screens such as a registration information input screen and various operation screens. The display unit may be, for example, a display device such as a liquid crystal display (LCD) or an organic electroluminescence (EL) display, for example. The output unit <NUM> according to the embodiment, under control by the content output control unit <NUM>, outputs specific content distributed from the server <NUM> to present to the user.

The storage unit <NUM> is realized by read only memory (ROM) that stores information such as programs and computational parameters used in processes by the control unit <NUM>, and random access memory (RAM) that temporarily stores information such as parameters that change as appropriate. Also, the storage unit <NUM> according to the embodiment stores user information such as the user ID.

The above specifically describes a configuration of the user terminal <NUM> according to the embodiment. Note that the configuration of the user terminal <NUM> according to the embodiment is not limited to the example illustrated in <FIG>. For example, part of the configuration may also be provided in an external device.

<FIG> is a block diagram illustrating one example of the configuration of the server <NUM> according to the embodiment. As illustrated in <FIG>, the server <NUM> includes a control unit <NUM>, a communication unit <NUM>, and a storage unit <NUM>.

The control unit <NUM> functions as an operation processing unit and a control unit, and controls the entire operation in the server <NUM> according to various kinds of programs. The control unit <NUM> is achieved by an electric circuit such as a central processing unit (CPU)) or a microprocessor. Further, the control unit <NUM> may include read only memory (ROM)) that stores programs to be used, operation parameters, etc., and random access memory (RAM)) that temporarily stores parameters that change appropriately, etc..

Also, the control unit <NUM> according to the embodiment functions as a content registration unit <NUM>, a user management unit <NUM>, an unpleasant area determination unit <NUM>, and a content distribution control unit <NUM>.

The content registration unit <NUM> registers information related to content to distribute (also referred to as distribution information) in a content management DB <NUM> according to a request from each of the content business servers <NUM>. Besides the content data to distribute, the distribution information may also include distribution conditions.

The user management unit <NUM> uses a user management DB <NUM> to manage user-related information (registration information). Specifically, the user management unit <NUM> acquires information such as the name of the user and various profiles from the user terminal <NUM>, and stores the acquired information in the user management DB <NUM>.

The unpleasant area determination unit <NUM> determines an area estimated to make people staying in the area feel unpleasant. Herein, "unpleasant" refers to negative emotions, and corresponds to "Unpleasant" indicated in Russell's circumplex model of emotion for example. The circumplex model of emotion is indicated by the two-dimensional axes of "Activated/Deactivated" and "Pleasant/Unpleasant". Specifically, unpleasant (negative) emotions are anticipated to be emotions such as anger, irritation, boredom, and depression. For example, in the case of being in a crowded area (an area in which may people are densely packed together, such as on a crowded train, inside a train station, in a department store, or at an event venue for example) or waiting in a long line, it is anticipated that the user will experience unpleasant emotions due to boredom and irritation.

Consequently, the unpleasant area determination unit <NUM> is capable of determining whether or not an area is making people feel unpleasant according to the state of crowding (congestion) in the area. Specifically, the unpleasant area determination unit <NUM> ascertains and determines a crowded area or an area where a long line has formed to be an unpleasant area, on the basis of information such as position information acquired from each user terminal <NUM>, information acquired from the camera sensor 4A, and information acquired from the people flow sensor 4B.

Whether or not an area is a crowded area or an area where a long line has formed is determined according to the following method, for example.

First, by investigating locations and times of day when crowding occurs at popular shops in the city, amusement parks, resorts, and the like to accumulate information in a crowded zone information database (DB) <NUM>, the unpleasant area determination unit <NUM> can determine whether or not a zone has become an unpleasant area according to the time period. Herein, <FIG> illustrates one example of crowded zone information. As illustrated in <FIG>, times of day when crowding occurs are set for individual areas (an area is specified by a plurality of latitude and longitude points for example, and is a polygonal region enclosed by these points). Also, the congestion during crowded times may also be set. In the example illustrated in <FIG>, the congestion is expressed by an average number of people in line or by an artificial density. Note that "Area Type" illustrated in <FIG> indicates the type of area (what kind of shop, facility, or event).

Next, a method is also conceivable in which the camera sensor 4A and the people flow sensor 4B installed in each location, such as in the city and at event venues, are used to determine if the location is actually crowded or a line has actually formed. People count information and line-related information are transmitted from the camera sensor 4A and the people flow sensor 4B to the server <NUM> as congestion information related to the congestion.

The camera sensor 4A is provided with a motion capture function (person detection unit) that detects human shapes from a captured image, and thereby can detect persons present nearby. <FIG> is a diagram explaining the detection of persons by the camera sensor 4A. For example, as illustrated on the left side of <FIG>, the camera sensor 4A detects parts of the human body such as the head, hands, arms, and legs from a captured image <NUM>, and on the basis of how each part is moving, estimates posture and detects a person. With this arrangement, the camera sensor 4A can transmit information related to detected persons and a people count to the server <NUM>. Also, as illustrated on the right side of <FIG>, the camera sensor 4A is also capable of detecting a plurality of persons from a captured image <NUM>, and from the posture and direction in which the persons are facing, recognize that the persons are lined up, and detect the line. Additionally, the camera sensor 4A can also acquire the length of the line through shape detection of the persons.

Also, by performing face recognition on a captured image acquired from the camera sensor 4A, it is also possible to determine whether or not a target user is waiting in one of these lines. In this case, a face image of the user is registered in the user management DB <NUM> in advance. Alternatively, it is possible to use a device such as an infrared beacon worn on the user's body to make a determination on the basis of a user ID (beacon ID) emitted from the beacon. Also, by determining where the user is positioned in the line, the server <NUM> also becomes capable of computing the remaining wait time.

The people flow sensor 4B can receive radio waves to ascertain the number of user terminals existing nearby. For example, the people flow sensor 4B includes a Wi-Fi radio wave detection unit that intercepts Wi-Fi radio waves emitted from Wi-Fi terminals such as smartphones carried by users, and on the basis of the Wi-Fi radio wave detection results, the people flow sensor 4B can detect how many users are present nearby. The people flow sensor 4B transmits information regarding the detected number of terminals to the server <NUM>.

Note that the server <NUM> may also record measurement values such as actual people counts and lengths of lines transmitted from the camera sensor 4A and the people flow sensor 4B in this way to the crowded zone information DB <NUM> as crowding information, and further raise the accuracy of the crowding information. Note that in the case where current position information is transmitted from each user terminal <NUM> to the server <NUM>, the server <NUM> can ascertain the state of crowding (how many people there are) in each zone on the basis of the current position information from each user terminal <NUM>.

Although the above specifically describes the determination of an unpleasant area, the embodiment is not limited thereto, and the server <NUM> may also determine an unpleasant area by directly detecting the emotions of persons present in a specific area. For example, the server <NUM> may determine an unpleasant area on the basis of whether or not a user is experiencing unpleasant emotions, on the basis of information detected by various sensors in the user terminal <NUM> carried by the user. More specifically, in a case in where a vibration sensor senses that the user is shaking with a fixed short rhythm, such as when "nervously jiggling one's legs", or in a case where a microphone senses the sound of "clicking one's tongue", "sighing", or "yawning", the user is experiencing unpleasant emotions (such as anger, irritation, boredom, or depression), and therefore the area where the user is present is determined to be an unpleasant area. Also, in a case where the microphone continues to sense a situation in which no speech is emitted (in other words, silence) for a long period of time even through the user is engaged in activity with someone else, the server <NUM> can determine that the user is experiencing unpleasant emotions. In addition, it is also possible to use a biological sensor to sense the user's physical condition, such as a rising of the heart rate or a falling of the skin temperature, and thereby determine that the user is displeased. In addition, it is also possible to use a biological sensor to sense the user's physical condition, such as a rising of the heart rate, a falling of the skin temperature, or a "change in brain waves", and thereby determine that the user is displeased.

The content distribution control unit <NUM> distributes corresponding content registered in the content management DB <NUM> to a specified or unspecified large number of users present in a location determined to be an unpleasant area by the unpleasant area determination unit <NUM>, or to users waiting in line in an unpleasant area. The position of a user may be ascertained on the basis of position information transmitted from the user terminal <NUM>. Because users staying in an unpleasant area are presumed to be experiencing negative emotions, distributing content makes it possible to relieve the negative circumstances and enable the users to have fun. Note that because special content is obtained when users are present in a crowded area or waiting in line according to the embodiment, it is anticipated that the emotions of the users will change to positive emotions (pleasant circumstances), but the content distribution control unit <NUM> distributes content in the case where users are present in a crowded location or waiting in line, regardless of the actual emotions of the individual users. For example, when content is distributed to a user actually harboring unpleasant emotions according to the method described above from among the users staying in an unpleasant area, when the same user is staying in the same unpleasant area again, the content may be distributed regardless of that user's emotions.

Note that the content distribution control unit <NUM> may also distribute corresponding content in the case where a predetermined condition regarding the time period, degree of crowding, or the like is additionally satisfied. A predetermined condition is a condition on content distribution preset by a content business, and can be specified according to parameters such as location, type of zone (such as specific shops, facilities, or events), time period, and crowding, for example.

The communication unit <NUM> connects to the network <NUM> in a wired or wireless manner, and transmits or receives data with each user terminal <NUM> through the network <NUM>. The communication unit <NUM> communicably connects to the network <NUM> by a method such as wired/wireless local area network (LAN) or wireless fidelity (Wi-Fi (registered trademark)). For example, the communication unit <NUM> according to the embodiment receives current position information from the user terminal <NUM>, and receives sensor data or analysis results based on sensor data (such as people count information and terminal count information) from the camera sensor 4A and the people flow sensor 4B. Also, the communication unit <NUM>, under control by the content distribution control unit <NUM>, causes content to be transmitted to a predetermined user terminal <NUM>.

The storage unit <NUM> is realized by ROM that stores information such as programs and computational parameters used in processes by the control unit <NUM>, and RAM that temporarily stores information such as parameters that change as appropriate. For example, the storage unit <NUM> according to the embodiment stores the content management database (DB) <NUM>, the user management DB <NUM>, and the crowded zone information DB <NUM>.

The content management DB <NUM> stores content-related information registered by content businesses, such as content and distribution conditions.

The user management DB <NUM> stores user information including information such as the names of users, user IDs, and profiles.

The crowded zone information DB <NUM> stores information related to crowded zones as illustrated in <FIG>.

The above specifically describes a configuration of the server <NUM> according to the embodiment. Note that the configuration of the server <NUM> illustrated in <FIG> is one example, and the embodiment is not limited thereto. For example, at least part of the configuration of the server <NUM> may also be in an external device, and at least part of each function of the control unit <NUM> may also be realized by the user terminal <NUM> or by an information processing terminal a relatively short communication distance away from the user terminal <NUM> (such as what is called an edge server, for example). In this way, by appropriately distributing each configuration element of the server <NUM>, it becomes possible to improve real-time performance, reduce the processing load, and furthermore guarantee security. Also, each configuration element and each DB of the control unit <NUM> illustrated in <FIG> may all be provided in the user terminal <NUM>, and the information processing system according to the embodiment may be executed by an application on the user terminal <NUM>.

Next, a registration process in the information processing system according to the embodiment will be described specifically using the drawings.

<FIG> is a flowchart illustrating an operating process for user registration. As illustrated in <FIG>, first, the user terminal <NUM> displays a user registration screen and receives the input of the user's name and various profiles (step S103).

Next, the user terminal <NUM> acquires a face image of the user (step S106), and also acquires a beacon ID of an infrared beacon if carried by the user (step S109).

Here, one example of the user registration screen at this point is illustrated in <FIG>. As illustrated in <FIG>, on a user registration screen <NUM>, fields for registering the name, face photo, infrared beacon ID, and preferred content genre are displayed. The face photo and the infrared beacon ID are used when determining whether or not the user is actually waiting in line.

Next, the user terminal <NUM> transmits the acquired user information to the server <NUM> (step S112).

Subsequently, the user management unit <NUM> of the server <NUM> registers the received user information in the user management DB <NUM> (step S115). At this time, the user management unit <NUM> manages the user information by assigning a unique user ID.

The above describes the user registration process. Note that user registration is not a requirement to enjoy content distribution according to the embodiment, and it is possible to distribute corresponding content to users who have not performed user registration when such users are present in an unpleasant area.

Next, the registration of content by a content business will be described with reference to <FIG>. A content business can register, in the server <NUM>, special content to be distributed in cases where a predetermined zone becomes crowded or a line forms. The content registered for distribution may also double as advertising.

<FIG> is a flowchart illustrating an operating process for content registration. As illustrated in <FIG>, first, one of the content business servers <NUM> displays a content registration screen with respect to the content business, and receives a specification of content to distribute and distribution conditions (step S123).

Here, one example of the content registration screen at this point is illustrated in <FIG>. As illustrated in <FIG>, on a content registration screen <NUM>, it is possible to specify content distribution conditions and register content to distribute. Anticipated examples of conditions for distributing content include the following.

Additionally, whether or not to distribute content only to registered users can also be selected.

Next, the content business server <NUM> transmits the input distribution information to the server <NUM> (step S126).

Subsequently, the content registration unit <NUM> of the server <NUM> registers the received distribution information in the content management DB <NUM> (step S129).

The above specifically describes the process of registering content to distribute.

Next, the distribution of content will be described specifically using the drawings.

As described above, when the server <NUM> determines that a zone is crowded or that a line has formed on the basis of preregistered crowding information for each zone or information actually detected by the camera sensor 4A and the people flow sensor 4B for example, content to distribute with conditions matching the state of crowding in the zone is distributed in the case where such content has been registered.

Also, in the case where user registration is performed, when it is determined that a user is present in a crowded zone or is waiting in line on the basis of position information regarding each user transmitted from the user terminal <NUM> and a face analysis result of a captured image acquired by a nearby camera sensor 4A, the server <NUM> may distribute corresponding content to the user terminal <NUM>.

In the case of a user who has performed user registration, benefits like the following may be provided.

Herein, <FIG> illustrates one example of a content presentation screen displayed on the user terminal <NUM> during content distribution. As illustrated in <FIG>, on a content presentation screen <NUM>, "General Content" that is also distributed to unregistered users and "Content for Premium Users" that is distributed only to registered users are presented. The "Content for Premium Users" may also be visible only to registered users. In "Content for Premium Users", content viewable/listenable by premium users, content that can be continued from the last time, content that is recommended given the remaining wait time in line, and content that is recommended according to the user's preferred genre are presented. The user is able to select any of the content for viewing or listening on the user terminal <NUM>.

Next, in cases such as waiting in line at a theme park attraction or restaurant, waiting in line for a specific video game at a game shop, or waiting in line for a specific event, it is possible to present not only video content, but also bonus content in which a character related to the line, such as a related theme park character, video game character, or event character, appears for the user waiting in line.

For example, a character may be made to appear on the user terminal <NUM> carried by the user, on signage installed near the line, or the like. The description hereinafter will refer to <FIG>.

<FIG> is a diagram explaining an example of character content distribution according to the embodiment. As illustrated in <FIG>, an AR image <NUM> of a character is displayed on the user terminal <NUM>, and may be displayed superimposed onto a real image. Additionally, a comment such as "Thank you for waiting in line!" may be output in the voice of the character.

<FIG> is a diagram explaining a case of distributing character content on signage. For example, in the case where a line is detected at a user's current position, the server <NUM> distributes content to a display device such as signage installed near the line. In other words, as illustrated in <FIG>, it is possible to make a character <NUM> appear on a signage device <NUM> installed near a line L, output a message such as "Thanks for waiting in line!" in the voice of the character, and keep people from becoming bored while waiting in line. In this case, content can be distributed equally not only to registered users but to all nearby users.

Note that content may also be distributed from the signage device <NUM> to a nearby user terminal <NUM>. For example, it is possible to distribute content from the signage device <NUM> to a nearby user terminal <NUM> by Wi-Fi Direct or short-range wireless communication. Also, rather than the signage device <NUM>, a communication device (hotspot) capable of distributing content directly to a nearby user terminal <NUM> may be installed, and specific content for relieving negative circumstances may be distributed from the communication device to a nearby user terminal <NUM> when the area is determined to be an unpleasant area. In this case as well, content can be distributed equally not only to registered users but to all nearby users.

<FIG> is a diagram explaining a usage example of the case where a character is displayed by AR. As illustrated in <FIG>, in the case where a character is displayed by AR on the user terminal <NUM>, the user is able to perform an action such as taking a two shot of the user him- or herself with an AR image <NUM> of the character.

<FIG> is a diagram explaining a case of distributing three-dimensional (3D) content as an instance of AR content. For example, in the case where precise positioning in units of centimeters is possible with the use of technology such as ultra-wideband (UWB) wireless communication, accurate control of the display position and direction of AR content according to the position of each user and the direction in which the user is pointing a camera of the user terminal <NUM> such as a smartphone becomes possible. As illustrated in <FIG> for example, the same character can be displayed (3D content presented as a 2D image) on the user terminals 1a and 1b of a plurality of users. In this case, by adjusting the display position and direction of the 3D content such as a character according to the position and camera direction of each user, and by controlling the playback of movements and speech by the same characters 55a and 55b at the same time on the user terminals 1a and 1b of the plurality of users, the fusion with the real space becomes more realistic, and a shared experience among a plurality of users becomes possible.

Also, in cases where user registration is performed, it is also possible to display the character on only the user terminal of a user or voice a comment matching the user's circumstances (such as "This is the third time you've lined up for this today!") according to an activity pattern of the user, such as the number of times or the amount of time that the user has been waiting in line.

Next, an operating process of content distribution will be described using a plurality of Examples.

First, content distribution in a location where the camera sensor 4A and the people flow sensor 4B are not installed will be described. In this case, the server <NUM> distributes content on the basis of preregistered crowded zone information.

For example, in a case where the state of crowding is acquirable in advance, such as at a popular ramen shop or an amusement park, by registering crowded time periods and time periods when a line forms as the crowded zone information, the server <NUM> can determine unpleasant areas.

Herein, <FIG> illustrates one example of crowded zone information for a ramen shop. As illustrated in <FIG>, congestion information is registered for respective time periods for the area of a popular ramen shop for example. Specifically, for a morning time period, an average of <NUM> persons waiting in line is registered, while for a lunch time period, an average of <NUM> persons waiting in line is registered, and for an afternoon time period, an average of <NUM> persons waiting in line is registered. With this arrangement, the unpleasant area determination unit <NUM> of the server <NUM> can determine that the area is an unpleasant area during the registered time periods. In addition, the content distribution control unit <NUM> controls the distribution of corresponding content on the basis of the registered congestion.

Herein, <FIG> illustrates one example of crowded zone information for an amusement park. As illustrated in <FIG>, the congestion is also registered for respective time periods for an amusement park. The unpleasant area determination unit <NUM> of the server <NUM> can determine that the area is an unpleasant area during the registered time periods. In addition, the content distribution control unit <NUM> controls the distribution of corresponding content on the basis of the registered congestion.

Next, an operating process according to the present Example will be described with reference to <FIG> and <FIG>. <FIG> and <FIG> are sequence diagrams illustrating a content distribution process according to a First Example of the embodiment.

As illustrated in <FIG>, first, the user terminal <NUM> measures the current position (step S203).

Next, if the user is unregistered (step S206/No), the user terminal <NUM> transmits current position information to the server <NUM> (step S212). Note that the measurement and transmission of the current position to the server <NUM> may be executed by a dedicated application installed in the user terminal <NUM>.

Next, the unpleasant area determination unit <NUM> of the server <NUM> references the crowded zone information DB <NUM> and determines whether or not the location where the user is currently present is crowded on the basis of the received position information and the current time (step S215). For example, in the case where the user's current position is inside the area of the ramen shop illustrated in <FIG> and the current time is <NUM>:<NUM>, because the area is registered as a crowded zone, the unpleasant area determination unit <NUM> determines that the area is crowded (a crowded zone).

Next, in the case of determining that the area is a crowded zone (step S218/Yes), the content distribution control unit <NUM> acquires a list of content corresponding to the position information, the time, and the congestion from the content management DB <NUM> (step S221), and transmits the acquired list of content (content list) to the user terminal <NUM> (step S224). For example, in the case where distribution information is registered to indicate that certain content is to be distributed when the congestion is an "average of <NUM> persons or more waiting in line" in the "ramen shop area", the content distribution control unit <NUM> acquires a list of the relevant content in accordance with the distribution conditions.

Next, the user terminal <NUM> selects any piece of content from the content list (step S227), and requests the server <NUM> to distribute the selected content (step S230). For example, the user terminal <NUM> may display the content presentation screen <NUM> as illustrated in <FIG> to enable the user to select any piece of content from the content list. Note that the "Content for Premium Users" illustrated in <FIG> is not displayed at this point.

Subsequently, the server <NUM> transmits content according to the request (step S233), and the content is played back on the user terminal <NUM> (step S236).

Next, <FIG> will be referenced to describe content distribution in the case where the user is registered.

In the case where the user is registered (step S206/Yes), the user terminal <NUM> transmits the current position information and user ID to the server <NUM> (step S243). Note that the measurement of the current position and the transmission of the current position and the user ID to the server <NUM> may be executed by a dedicated application installed in the user terminal <NUM>.

Next, the content distribution control unit <NUM> of the server <NUM> acquires user information (such as a viewing/listening history and a preferred genre) from the user management DB <NUM> on the basis of the user ID (step S246).

Next, the content distribution control unit <NUM> acquires a list of registered content that matches the received position information and the current time (step S249). For example, in the case where the user's current position is inside the "ramen shop area" and the congestion at the current time is an "average of <NUM> persons or more waiting in line", a list of distributable content matching such conditions is acquired in accordance with the distribution information registered in the content management DB <NUM>.

Next, the content distribution control unit <NUM> extracts a list of partially viewed/listened-to content on the basis of the acquired content list and the user's viewing/listening history (step S252). For example, partially viewed/listened-to content can be grasped because a viewing/listening history of content that was distributed and viewed or listened to by the user when the user waited in line previously is registered in the user management DB <NUM>. Note that in addition to the partial playback of a movie or drama show, partial viewing/listening is also used to refer to being midway through a series for content that is created in series, such as Season <NUM> in the case where the user has finished viewing or listening to Season <NUM>.

Also, the content distribution control unit <NUM> extracts a list of content matching the user's preferred genre from out of the acquired content list (step S255).

The extraction of a partially viewed/listened-to content list and the extraction of a content list matching a preferred genre described above are positioned as premium services performed for registered users.

Next, the content distribution control unit <NUM> transmits the acquired content list, the partially viewed/listened-to content list, and the list of content in the preferred genre to the user terminal <NUM> (step S258).

Next, the user terminal <NUM> selects any piece of content from each content lists (step S261), and requests the server <NUM> to distribute the selected content (step S264). For example, the user terminal <NUM> may display the content presentation screen <NUM> as illustrated in <FIG> to enable the user to select any piece of content from the content list. As illustrated in <FIG>, the partially viewed/listened-to content list ("Resume viewing/listening", and the content list matching the preferred genre ("Recommended according to preferred genre") may be presented for premium users (registered users). The "Viewable/listenable content" corresponds to the content registered as "distribute only to registered users" in the content registration by the business side described with reference to <FIG>, and is included in the content list acquired in the above step S249. Note that "Recommended according to remaining time in line" illustrated in <FIG> is not displayed at this point, and will be described in the Third Example.

Subsequently, the server <NUM> transmits content according to the request (step S267), and the content is played back on the user terminal <NUM> (step S270).

Next, a Second Example will be described. In the Second Example, a case will be described in which the camera sensor 4A and the people flow sensor 4B are installed in locations such as a shopping area, a resort, or inside a commuter train car, and the congestion is actually measured on the basis of data from these sensors. For example, the camera sensor 4A and the people flow sensor 4B are provided inside a train, making it possible to count the number of passengers (people getting on and off) and compute the congestion on the train. Sensor data is transmitted to the server <NUM> as needed.

In the case where a user is present in a crowded zone on the basis of a crowded zone determination result based on current position information transmitted from the user terminal <NUM> and the above sensor data, because the user is presumed to be experiencing negative circumstances, the server <NUM> can distribute corresponding content and thereby alleviate the negative circumstances. Note that in the case where there are many users of this system, current positions will be transmitted continually from a large number of users, and therefore the server <NUM> is also capable of computing the congestion of each zone on the basis of the position information from all users.

Hereinafter, an operating process according to the Second Example will be described with reference to <FIG> are sequence diagrams illustrating a content distribution process according to the present Example.

As illustrated in <FIG>, first, the people flow sensor 4B receives Wi-Fi radio waves (step S303), determines whether or not (one or more) Wi-Fi terminals (an information processing terminal that emits Wi-Fi radio waves; corresponds to the user terminal <NUM> in the present Example) exists nearby (step S306), and if (one or more) terminals exist, the people flow sensor 4B computes the number of terminals existing nearby (step S309).

Next, the people flow sensor 4B transmits terminal count information to the server <NUM> (step S312). The transmission of the terminal count information may be performed continually.

Subsequently, the camera sensor 4A installed in each location captures an image of the surroundings (step S313), determines whether or not any persons are included in the captured image (step S315), and if any persons are included, computes a people count (step S318). For example, the camera sensor 4A is capable of detecting persons with the motion capture function that detects the shapes of persons from the captured image, and computing the people count.

Next, the camera sensor 4A transmits people count information to the server <NUM> (step S321). The transmission of the people count information may be performed continually. Note that although the camera sensor 4A computes the people count based on a captured image as one example herein, the embodiment is not limited thereto, and the people count may also be computed by an external device on the basis of the captured image acquired by the camera sensor 4A. For example, the current number of people (density) in a predetermined zone may be totaled by an intermediate server on the basis of captured images from a plurality of camera sensors 4A installed in the zone, and output to the server <NUM>.

Next, the user terminal <NUM> measures the current position (step S324), and if the user is unregistered (step S327/No), the user terminal <NUM> transmits current position information to the server <NUM> (step S330). The measurement and transmission of the current position to the server <NUM> may be executed by a dedicated application installed in the user terminal <NUM>.

Subsequently, the server <NUM> computes the total number of users present in the same certain location on the basis of position information from each user terminal (step S333).

Next, as illustrated in <FIG>, the unpleasant area determination unit <NUM> of the server <NUM> treats the largest numerical value from among the total number of users in a certain location computed in the above step S333, the people count information acquired from the camera sensor 4A installed in that location, and the terminal count information acquired from the people flow sensor 4B installed in the same location as the people count (congestion) of that location (step S336). With this arrangement, the congestion in the user's current location can be grasped.

Subsequently, the content distribution control unit <NUM> references the content management DB <NUM> and searches for content corresponding to the area type of the location, the time period, and the congestion (step S339). For example, in the case where the user's current location is inside an "area of Lan-Lan Land (amusement park)" and the current congestion is "<NUM> persons per <NUM> meters square", the content management DB <NUM> is searched to create a list of distributable content matching such conditions in accordance with the distribution information registered in the content management DB <NUM>.

Next, in the case where corresponding content is registered (step S342/Yes), the content list is transmitted (step S345).

Next, the user terminal <NUM> selects any piece of content from the content list (step S348), and requests the server <NUM> to distribute the selected content (step S351).

Subsequently, the server <NUM> transmits content according to the request (step S354), and the content is played back on the user terminal <NUM> (step S357).

In the case where the user is registered (step S327/Yes, <FIG>), as illustrated in <FIG>, the user terminal <NUM> transmits the current position information and user ID to the server <NUM> (step S360). Note that the measurement of the current position and the transmission of the current position and the user ID to the server <NUM> may be executed by a dedicated application installed in the user terminal <NUM>.

Next, the unpleasant area determination unit <NUM> of the server <NUM> computes the total number of users present in the same certain location on the basis of position information from each user terminal <NUM> (step S363).

Next, the unpleasant area determination unit <NUM> of the server <NUM> treats the largest numerical value from among the total number of users in a certain location computed in the above step S363, the people count information acquired from the camera sensor 4A installed in that location, and the terminal count information acquired from the people flow sensor 4B installed in the same location as the people count (congestion) of that location (step S366). With this arrangement, the congestion in the user's current location can be grasped.

Next, the content distribution control unit <NUM> references the content management DB <NUM> and searches for content corresponding to the area type of the location, the time period, and the congestion (step S369).

Next, in the case where corresponding content is registered (step S372/Yes), as illustrated in <FIG>, the content distribution control unit <NUM> acquires user information (such as the viewing/listening history and preferred genre) from the user management DB <NUM> on the basis of the user ID (step S375).

Subsequently, the content distribution control unit <NUM> acquires a list of registered content that matches the received position information and the current time (step S378).

Next, the content distribution control unit <NUM> extracts a list of partially viewed/listened-to content on the basis of the acquired content list and the user's viewing/listening history (step S381).

Also, the content distribution control unit <NUM> extracts a list of content matching the user's preferred genre from out of the acquired content list (step S384).

The extraction of a partially viewed/listened-to content list and the extraction of a content list matching a preferred genre described above are positioned as premium services performed for registered users, similarly to the First Example.

Next, the content distribution control unit <NUM> transmits the acquired content list, the partially viewed/listened-to content list, and the list of content in the preferred genre to the user terminal <NUM> (step S387).

Next, the user terminal <NUM> selects any piece of content from each content list (step S390), and requests the server <NUM> to distribute the selected content (step S393).

Subsequently, the server <NUM> transmits content according to the request (step S396), and the content is played back on the user terminal <NUM> (step S399).

Next, the case of distributing content according whether or not a line is sensed by the camera sensor 4A installed in a location such as a shopping area, a resort, or inside a commuter train car will be described. Because the shapes of persons can be recognized by the camera sensor 4A, the length and progression of a line can also be grasped.

The camera sensor 4A detects a line and continually transmits information such as the length of the line (how many people are lined up) and face recognition results of persons waiting in the line to the server <NUM>. From the current position information transmitted from the user terminal <NUM>, the server <NUM> determines whether or not the user is in a zone (crowded zone) where a line has formed, and additionally determines whether the user is actually waiting in the line on the basis of the face recognition results. The face recognition of the user may be performed using a preregistered face image of the user. Additionally, the server <NUM> distributes corresponding specific content to the user while the user is waiting in line. For example, it is also possible to distribute content according to the remaining wait time in line.

Hereinafter, an operating process according to the Third Example will be described with reference to <FIG> are sequence diagrams illustrating a content distribution process according to the present Example.

As illustrated in <FIG>, first, the camera sensor 4A installed in each location captures an image of the surroundings (step S403), analyzes the captured image to determine whether or not a line containing a plurality of persons is successfully detected (step S406), and in the case of successfully detecting a line, the camera sensor 4A recognizes the faces of the persons waiting in line and acquires feature data for each face (step S409). The camera sensor 4A can detect persons with the motion capture function that detects the shapes of persons from the captured image, determine that a line has formed in the case where a plurality of persons is lined up, and detect the line.

Next, the camera sensor 4A transmits people count information regarding the line (or information regarding the length of the line) and information regarding the face features of the persons in line to the server <NUM> (step S412). The transmission of this information may be performed continually. Note that in this Example, similarly to the Second Example, the analysis of captured images (herein, the line detection and face recognition) may also be performed by an external device other than the camera sensor 4A. For example, the computation of a line in a predetermined zone and the face recognition may be performed by an intermediate server on the basis of captured images from a plurality of camera sensors 4A installed in the zone, and output to the server <NUM>.

Next, the unpleasant area determination unit <NUM> of the server <NUM> records the people count information and face feature information regarding the line received from the camera sensor 4A in the crowded zone information DB <NUM> (step S415).

Next, the unpleasant area determination unit <NUM> computes the speed of progress in the line on the basis of a history of recorded information related to the line received from the camera sensor 4A (step S418).

Next, the user terminal <NUM> measures the current position (step S421), and if the user is registered (step S424/Yes), the user terminal <NUM> transmits the current position information and the user ID to the server <NUM> (step S427). The measurement of the current position and transmission of the current position information and the user ID to the server <NUM> may be executed by a dedicated application installed in the user terminal <NUM>.

Next, as illustrated in <FIG>, the unpleasant area determination unit <NUM> of the server <NUM> determines whether or not a line has formed in the location where the user is present on the basis of current position information transmitted from the user terminal <NUM> (step S430).

Next, in the case where a line has formed (step S430/Yes), the unpleasant area determination unit <NUM> determines whether or not the user is included among the people waiting in line (step S433). Specifically, it is determined whether or not the user is actually waiting in the line, on the basis of the face feature information for each person waiting in line and the preregistered face image of the user. Note that as one example herein, a line is detected on the basis of a captured image taken by the camera sensor 4A and it is furthermore determined whether or not the user is actually waiting in line by face recognition. However, the embodiment is not limited to the above, and it is also possible to perform the detection of a line and the determination of whether or not a user is actually waiting in line on the basis of position information from each user. In other words, in the case where the position of each user can be ascertained precisely, such as in units of centimeters, from the current position information transmitted from each user terminal <NUM> for example, the unpleasant area determination unit <NUM> is capable of recognizing that a plurality of users has formed a line on the basis of the position information regarding each user, and the line can be detected. With this arrangement, because the position of the line is understood, the unpleasant area determination unit <NUM> can cross-reference the current position information regarding a user to determine whether or not the user is waiting in the line.

Next, in the case where the user is included in the line (step S433/Yes), the unpleasant area determination unit <NUM> computes the user's wait time on the basis of the length of the line, the user's position in the line, and the speed of progress in the line (step S436).

Next, the content distribution control unit <NUM> references the content management DB <NUM> and searches for content corresponding to the area type of the location, the time period, and the congestion (step S439).

Next, in the case where corresponding content is registered (step S442/Yes), the content distribution control unit <NUM> acquires a list of content from the content management DB <NUM> (step S445).

Next, a list of content whose length is suited to the wait time is extracted from out of the acquired content list (step S448). Content whose length is suited to the wait time is anticipated to be video or music that the user can finish watching or listening to within the wait time, for example.

Next, as illustrated in <FIG>, the content distribution control unit <NUM> of the server <NUM> acquires user information (such as a viewing/listening history and a preferred genre) from the user management DB <NUM> on the basis of the user ID (step S451).

Next, the content distribution control unit <NUM> extracts a list of partially viewed/listened-to content on the basis of the acquired content list and the user's viewing/listening history (step S454).

Also, the content distribution control unit <NUM> extracts a list of content matching the user's preferred genre from out of the acquired content list (step S457).

The extraction of a partially viewed/listened-to content list, the extraction of a content list suited to the wait time, and the extraction of a content list matching a preferred genre described above are positioned as premium services performed for registered users, similarly to the First and Second Examples.

Next, the content distribution control unit <NUM> transmits the acquired content list, the content list suited to the wait time, the partially viewed/listened-to content list, and the list of content in the preferred genre to the user terminal <NUM> (step S460).

Next, the user terminal <NUM> selects any piece of content from each content list (step S463), and requests the server <NUM> to distribute the selected content (step S466).

Subsequently, the server <NUM> transmits content according to the request (step S469), and the content is played back on the user terminal <NUM> (step S472).

As described above, the information processing system according to the embodiment of the present disclosure is capable of distributing special content for relieving a user's negative circumstances.

Specifically, because people tend to experience negative emotions when in a crowded location such as inside a commuter train car or when waiting in line at an amusement park or popular shop, by having the information processing system according to the embodiment distribute predetermined special content presented only to persons who have put themselves in such locations, it is possible to relieve the negative circumstances and enable the persons to have fun.

Content may be distributed to all users present in the crowded location, or only to specific users (such as registered users, or registered users who are actually waiting in line).

Also, the embodiment describes how the content to distribute is preregistered in the server <NUM> by content businesses, but the embodiment is not limited thereto. For example, an unpleasant area determination result by the server <NUM> may be presented to a content business, and the distribution of content to the unpleasant area may be performed on the content business side.

The preferred embodiment(s) of the present disclosure has/have been described above with reference to the accompanying drawings, whilst the present technology is not limited to the above examples.

For example, it is also possible to create a computer program causing hardware such as the CPU, the ROM and the RAM installed in the above user terminal <NUM> or the server <NUM> to implement the function of the user terminal <NUM> or the server <NUM>. Further, a computer-readable storage medium having the computer program stored therein is also provided.

Claim 1:
An information processing system comprising:
a communication unit (<NUM>) configured to receive at least current position information regarding a user by a position sensor (<NUM>) and congestion information related to a congestion of an area; and
a control unit (<NUM>) configured to
determine that a predetermined area containing the position indicated by the current position information is an area that makes people staying in the predetermined area feel unpleasant on a basis of the congestion information and based on estimating whether the user is waiting in a line on a basis of the current position information regarding the user and on a basis of face recognition performed on an image captured by a camera sensor (4A), and
cause the communication unit (<NUM>), if the control unit (<NUM>) determines that the predetermined area containing the position indicated by the current position information is an area that makes people staying in the predetermined area feel unpleasant, to distribute specific content to the user,
wherein the specific content is AR content related to the line to be distributed to a display device disposed near the user if the user is estimated to be waiting in the line, and
wherein the display device disposed near the user includes a display terminal device carried by an other user present near the user, and the control unit (<NUM>) is configured to cause the AR content related to the line to be distributed to display terminal devices carried by the user and the other user if the user is estimated to be waiting in the line.