Patent Description:
In recent years, it has been become possible to provide a new function including internet of things (IOT) in such a way that a plurality of information processing apparatuses communicates and operates with one another.

For example, Patent Document <NUM> below discloses a display apparatus that has a display screen and is capable of communication, the display apparatus including an attribute management unit that manages attribute information corresponding to edge pieces obtained when an edge of a display screen is divided; an apparatus management unit that identifies different equipment that is co-operable by communication corresponding to at least one of identification information or attribute information of the edge pieces; and a display control unit that causes management of the different equipment or cooperation with the different equipment to be displayed on the display screen of the display apparatus. When the equipment is identified corresponding to the edge pieces of the display screen in the above manner, it is possible to obtain an advantageous effect that it becomes easy for the user to manage the equipment. For example, the user can easily grasp a direction in which, with reference to the display screen, the equipment which is a management target is positioned.

<CIT> relates to an information processing device, which generates a response to a speech from a user, decides an appropriate response output method in accordance with a current surrounding environment, and output the generated response by using the decided response output method.

However, depending on the prior technology of Patent Document <NUM> or the like, it is difficult to properly control a projection of an object for which a message is notified to the user on the basis of the attribute of the message.

Thus, the present disclosure proposes a novel and improved information processing apparatus and information processing method that can more properly control a projection of an object for which a message is notified to a user on the basis of the attribute of the message.

According to a first aspect, the invention provides an information processing apparatus in accordance with independent claim <NUM>. According to a second aspect, the invention provides an information processing method in accordance with independent claim <NUM>. Further aspects of the invention are set forth in the dependent claims, the drawings and the following description.

According to the present disclosure, there is provided an information processing apparatus including: an acquisition unit that acquires a message; and a control unit that controls projection of an object notifying a user of the message on the basis of an attribute of the message.

Moreover, according to the present disclosure, there is provided an information processing method executed by a computer including: acquiring a message; and controlling projection of an object notifying a user of the message on the basis of an attribute of the message.

As described above, according to the present disclosure, it is possible to more properly control a projection of an object for which a message is notified to the user on the basis of the attribute of the message.

Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that, in this description and the drawings, configuration
elements that have substantially the same function and configuration are denoted with the same reference numerals, and repeated explanation is omitted.

Note that the description is given in the order below.

First, the background of the present disclosure is described.

As described above, depending on the prior technology of Patent Document <NUM> or the like, it is difficult to properly control a projection of an object for which a message is notified to the user on the basis of the attribute of the message.

For example, there is a function to project an object to a display or the like that notifies the user of a message in a case where the information processing apparatus (e.g., an agent apparatus or smartphone) owned by the user receives the certain message. Thus, the user can recognize that the information processing apparatus has received the message.

Now, for example, in a case where the user waits for arrival of home delivery, the user wants to know a separation distance from a courier. In a case where if the courier transmits a certain message (e.g., a message related to a movement situation or the like) to the information processing apparatus owned by the user, depending on a conventional technology, the information processing apparatus cannot control (change) the projection of an object on the basis of the attribute of the message. In other words, because the object is projected uniformly, the user cannot know a separation distance from the courier from the object.

Furthermore, for example, in a case where the user is in a house and any of the plurality of information processing apparatuses in the house receives a message from an external apparatus, the user wants to know which information processing apparatus has received the message. However, depending on a conventional technology, the information processing apparatus cannot control (change) the projection of an object on the basis of the attribute of the message. Therefore, the user cannot know from the object which information processing apparatus has received the message.

Furthermore, for example, regardless of the attribute of the message or the like, when the object including the content of the message is projected uniformly, the content of the message can be conveyed even to another user who should not view.

The disclosure of the present case has arrived at creating the technology according to the present disclosure in view of the aforementioned situation. The information processing apparatus <NUM> according to the present disclosure can control the projection of an object that gives a notification of a message on the basis of the attribute of the message.

For example, the information processing apparatus <NUM>, which has received a message from a courier, can change an object to be projected to an object that indicates a separation distance from the courier, or the like, on the basis of the attribute of the message. Furthermore, for example, in a case where any of the plurality of the information processing apparatuses <NUM> in a house has received the message from an external apparatus, the information processing apparatus <NUM>, which has received the message, can change an object to be projected to an object that indicates a direction from the user to the information processing apparatus <NUM>, or the like, on the basis of the attribute of the message. Therefore, the user who has recognized the object can intuitively specify the information processing apparatus <NUM>, which has received the message, on the basis of the direction.

Furthermore, the information processing apparatus <NUM> can control the content of the object depending on the attribute of the message or the like. In this way, for example, in a case where another use who should not view the content of the message is present nearby, the information processing apparatus <NUM> can project an icon indicating the message as an object, not the content of the message, or the like.

In the following, details of examples of the present disclosure are described in sequence. In the first example, description is given of an example in which a direction from the user to a message transmission source apparatus (e.g., the information processing apparatus <NUM>, an external apparatus, or the like) is indicated by object projection control. In the second example, description is given of an example in which a separation distance between the user and the message transmission source apparatus is indicated by object projection control. Finally, in the third example, description is given of an example in which both a direction from the user to the message transmission source apparatus and a separation distance between the user and the message transmission source apparatus are indicated by object projection control.

In the above description, the background of the present disclosure is described. Next, the first example according to the present disclosure is described. The first example is an example in which a direction from the user to the message transmission source apparatus is indicated by object projection control.

First, a system configuration example of the present example is described with reference to <FIG>. As illustrated in <FIG>, the present example includes the information processing apparatus <NUM> and a display apparatus <NUM>.

The information processing apparatus <NUM> is an apparatus that transmits a message to the display apparatus <NUM>, and is also an apparatus that projects any object for notifying the user of the message to the display apparatus <NUM>. For example, the information processing apparatus <NUM> projects an icon indicating the message, the content of the message, or the like to the display apparatus <NUM> as the object. Thus, the user can recognize that the message has been transmitted from the information processing apparatus <NUM> to the display apparatus <NUM>.

Furthermore, the information processing apparatus <NUM> can communicate with any external apparatus, and, in a case of receiving a message from the external apparatus, may project any object for notifying the user of the message to the display apparatus <NUM>. For example, the information processing apparatus <NUM> when receiving the message from the external apparatus, may project an icon indicating the message, the content of the message, or the like to the display apparatus <NUM> as the object. Thus, the user can recognize that the message from the external apparatus has been received by the information processing apparatus <NUM>.

Note that, as described above, the "message" includes not only those transmitted from the information processing apparatus <NUM> to the display apparatus <NUM>, but also those transmitted from the external apparatus to the information processing apparatus <NUM>.

Moreover, the information processing apparatus <NUM> controls the projection on the basis of the attribute of the message. Here, the attribute of the message includes various concepts. For example, examples of the attribute of the message include, but are not limited to, the type of message (or classification, category, or the like), information indicating the content of a message, information indicating software (application) used for transmitting or receiving a message, information indicating a message transmission source apparatus (e.g., information processing apparatus <NUM> or external apparatus), and information indicating a destination of a message (e.g., a destination user, the number of destinations, or the like).

A projection that indicates a direction from the user to the message transmission source apparatus is described more specifically. The information processing apparatus <NUM> recognizes coordinates in which each of points constituting an own apparatus, the display apparatus <NUM>, and other real objects is located on an orthogonal coordinate system of a three-dimensional space. Then, as illustrated in <FIG>, the information processing apparatus <NUM> calculates intersection P1' obtained when a normal line is drawn from central point P1 of the own apparatus toward a parallel surface passing through a projection surface (synonymous with the display of the display apparatus <NUM>) onto which projection is performed. Then, the information processing apparatus <NUM> calculates an intersection P1_in between a straight line, which passes central point C1 of the projection surface and the intersection P1', and an end of the projection surface. Finally, the information processing apparatus <NUM> projects any object for notifying the user of the message near intersection P1 in (e.g., a position after moving by a predetermined distance from intersection P1' in a direction P1_in_d of intersection P1_in with reference to intersection P1_in).

For example, in a case where the information processing apparatus <NUM>, which is a message transmission source, is positioned in an upward direction of the display apparatus <NUM> (e.g., in a case where the display apparatus <NUM> is positioned in a room on the first floor and the information processing apparatus <NUM> is positioned in a room on the second floor, which is immediately above the room), the object is projected near an end in an upward direction of the projection surface.

Thus, the user can intuitively recognize the direction from the display apparatus <NUM> to the information processing apparatus <NUM>, which is a message transmission source apparatus. Therefore, particularly, even in a case where a plurality of apparatuses having a function similar to that of the information processing apparatus <NUM> is present in a limited space such as a house or a facility, the user can intuitively specify the information processing apparatus <NUM> that is a transmission source.

Furthermore, the information processing apparatus <NUM> may indicate a direction from the display apparatus <NUM> to the message transmission source apparatus by also using animation, sound localization technology, or the like. More specifically, in a case where the message transmission source apparatus is positioned behind the display apparatus <NUM> (negative in z coordinate in <FIG>), the information processing apparatus <NUM> may project an animation in which object projection becomes gradually large or may change a sound image from a negative z coordinate position to a positive z coordinate position so as to express a state in which the object come closer to the user from afar. In contrast, in a case where the message transmission source apparatus is positioned in front of the display apparatus <NUM> (positive in z coordinate in <FIG>), the information processing apparatus <NUM> may project an animation in which object projection becomes gradually small or may change a sound image from a positive z coordinate position to a negative z coordinate position so as to express a state in which the object goes away from the user from nearby. Thus, the user can intuitively recognize the front-and-rear relationship between the display apparatus <NUM> and the message transmission source apparatus. Furthermore, in a case where the display apparatus <NUM> is a thing whose direction frequently varies, line a smartphone or the like, the object projection position is unstable and therefore the projection aspect of <FIG> is not appropriate. Therefore, in this case, the information processing apparatus <NUM> controls the projection position in the manner illustrated in <FIG> immediately after the object is projected, but may project the object in a predetermined position after a lapse of a predetermined period of time. Thus, the instability of the object projection position is reduced.

Note that, in the above example, technically, a direction from the "display apparatus <NUM>" to the message transmission apparatus (information processing apparatus <NUM>) is indicated. However, because the user is positioned in a location at which it is possible to visually recognize the projection surface of the display apparatus <NUM>, it can be said that the indication of the direction from the "display apparatus <NUM>" to the message transmission apparatus (information processing apparatus <NUM>) is equivalent to the indication of a direction from the "user" to the message transmission apparatus (information processing apparatus <NUM>).

Furthermore, the above is a mere example, and the processing aspect is not limited to the above. For example, as illustrated in <FIG>, the information processing apparatus <NUM> may project any object for notifying a user U1 of the message in a vicinity of the point on the projection surface that connects the user U1 and the message transmission apparatus (information processing apparatus <NUM>) with the substantially shortest distance.

More specifically, similar to the above, the information processing apparatus <NUM> recognizes coordinates in which each of points constituting an own apparatus, the display apparatus <NUM>, and other real objects (including the user U1) is located on an orthogonal coordinate system of a three-dimensional space. Then, as illustrated in <FIG>, the information processing apparatus <NUM> calculates a position of one point P1_in on the projection surface such that a path from the central point P1 of the own apparatus to an eye of the user U1 (either right eye or left eye; or the central point of the head of the user U1) via a point on the projection surface becomes substantially the shortest distance. Then, the information processing apparatus <NUM> may project an object in a vicinity of one point P1_in on the projection surface.

Furthermore, in that case, the information processing apparatus <NUM> may not project a mere object, but, as illustrated in <FIG>, may project an edited captured image of the information processing apparatus <NUM> and a surrounding real object as an object.

Thus, because it appears to the user as if the information processing apparatus <NUM> is specular-reflected at one point P1_in on the projection surface, the user can more intuitively recognize the direction to the information processing apparatus <NUM>.

Note that in the example of <FIG> and <FIG>, the method of imaging a captured image of the information processing apparatus <NUM> and a surrounding real object is not particularly limited. For example, the method may be achieved such that the display apparatus <NUM> includes an imaging function or the method may be achieved such that another external apparatus includes an imaging function and a captured image generated by the external apparatus is provided to the display apparatus <NUM>.

Furthermore, the type of the display apparatus <NUM> is not particularly limited. For example, the display apparatus <NUM> may be a television, a smartphone, personal computer (PC), a tablet PC, or the like with a display, which is a projection surface. Furthermore, the display apparatus <NUM> may be a projector or the like that can perform projection on the projection surface.

Furthermore, in the above, the information processing apparatus <NUM> controls projection of an object, but is not limited thereto. For example, a server (e.g., a cloud server) that can communicate with the information processing apparatus <NUM> is present, and the server may control the projection of an object. In this case, the server recognizes coordinates in which each of points constituting the information processing apparatus <NUM>, the display apparatus <NUM>, and other real objects is located on an orthogonal coordinate system of a three-dimensional space. Then, for example, in a case where the information processing apparatus <NUM> has received a message from the external apparatus, the information processing apparatus <NUM> cooperates with the server to that effect. Then, the server calculates point P1_in by the method similar to the above, and projects any object for notifying the user of the message in the vicinity of point the P1_in.

In the above, a system configuration example of the present example is described. Next, a functional configuration example of the information processing apparatus <NUM> is described with reference to <FIG>.

As illustrated in <FIG>, the information processing apparatus <NUM> includes a control unit <NUM>, an input unit <NUM>, a sensor unit <NUM>, an imaging unit <NUM>, an output unit <NUM>, a communication unit <NUM>, and a storage unit <NUM>.

The control unit <NUM> is a function configuration that collectively controls general processing the information processing apparatus <NUM> performs. For example, the control unit <NUM> can control activation and stop of each configuration on the basis of input performed by the user using the input unit <NUM> and control the output unit <NUM>, e.g., a display or a speaker. Furthermore, the control unit <NUM> can function as an acquisition unit that acquires the message. Note that the control content of the control unit <NUM> is not limited to the above. For example, the control unit <NUM> may control processing that is generally performed in an agent apparatus, a general-purpose computer, a PC, a tablet PC, a smartphone, or the like.

Furthermore, the control unit <NUM> is also a function configuration that recognizes a context using a variety of sensor information sensed by the sensor unit <NUM>, captured image information generated by the imaging unit <NUM>, or the like. Here, the context is a concept that entirely includes situations or environments where the user is in, states, actions or the like of the user. Note that the method of recognizing the context is not particularly limited, but it is sufficient if a publicly known context recognition technology used.

Then, the control unit <NUM> can control the projection of an object on the basis of the recognized context. More specifically, on the basis of the context, the control unit <NUM> can control whether to project an object such that a direction from the user to the message transmission source apparatus is indicated (first example), whether to project a separation distance between the user and the message transmission source apparatus (second example), and whether to project an object such that both a direction from the user to the message transmission source apparatus and a separation distance between the user and the message transmission source apparatus is indicated (third example).

For example, regarding the notification of the message from the information processing apparatus <NUM> present in a house, it is assumed that the projection of an object is performed such that a direction to the information processing apparatus <NUM> is indicated on the basis of the attribute of the message (first example). Then, in a case where if the control unit <NUM> recognizes the context in which the user looks for the own apparatus in the house, the control unit <NUM> may perform switching to a method (third example) that projects an object such that not only a direction from the user to the information processing apparatus <NUM>, but also a separation distance between the user and the information processing apparatus <NUM> is indicated on the basis of the context. Thus, the user can more easily find the information processing apparatus <NUM>. The object projection control based on the context is also referred to when the second example and the third example are described later.

Now, as illustrated in <FIG>, the control unit <NUM> includes a projection surface determination unit <NUM>, a projection position determination unit <NUM>, an object determination unit <NUM>, and a projection execution unit <NUM>.

The projection surface determination unit <NUM> is a function configuration that determines the projection surface to which projection is performed (synonymous with the display of the display apparatus <NUM> in the present example). More specifically, the projection surface determination unit <NUM> determines a projection surface that can be visually recognized by the user as a projection target. For example, the projection surface determination unit <NUM> analyzes a variety of sensor information provided by the sensor unit <NUM> so as to recognize the position, the posture, the action or the like of the user and output the projection surface that can be visually recognized by the user on the basis of such information. In a case where a plurality of projection surfaces that can be visually recognized by the user is present, the projection surface determination unit <NUM> outputs an optimum (in other words, the most visually recognizable for the user) projection surface. Then, the projection surface determination unit <NUM> provides the determined projection surface to the projection position determination unit <NUM>.

Note that the method for determining the projection surface to which projection is performed is not limited to the above. More specifically, the projection surface determination unit <NUM> may analyze not only the sensor information from the sensor unit <NUM>, but also sensor information provided from any external apparatus to recognize the position, the posture, the action or the like of the user and may acquire the information associated with the position, the posture, the action or the like of the user from the external apparatus. Furthermore, the projection surface determination unit <NUM> may determine the projection surface to which projection is performed on the basis of not only from the position, the posture, the action or the like of the user, but also the state of the display apparatus <NUM> (e.g., a state related to power on/off, a state related to display mode, or the like).

Furthermore, in the above, description is given of an example in a case where the projection surface is the display of the display apparatus <NUM>, but it is not limited to this. For example, the projection surface may be a projecting surface to which projection can be performed by a projector or the like, e.g., a screen.

The projection position determination unit <NUM> is a function configuration that determines the position of the projection surface to which projection is performed. More specifically, the projection position determination unit <NUM> outputs point P1 in of <FIG> or <FIG>. The method for outputting point P1_in is described above and description will be omitted. The projection position determination unit <NUM> provides information associated with the position to which projection is performed to the projection execution unit <NUM>.

The object determination unit <NUM> is a function configuration that determines the content of an object to be projected to the projection surface. For example, the object determination unit <NUM> may determine the content of the object on the basis of privacy of the message. For example, in a case where the message received by the information processing apparatus <NUM> includes content of personal information or the like, the object determination unit <NUM> may determine not the content of the message, but an icon corresponding to the message as the object.

Furthermore, the object determination unit <NUM> may determine the content of the object on the basis of the attribute of the message. More specifically, the object determination unit <NUM> may determine the content of the object on the basis of the type or the like (or classification, category or the like) of message, which is a type of the attribute of the message.

Furthermore, the object determination unit <NUM> may determine the content of the object on the basis of the context recognized by the control unit <NUM>. For example, as described above, even in a case where the privacy of the message is high, in a case where the context that is not visually recognized by a different user is recognized, the object determination unit <NUM> may determine the content of the message, not the icon corresponding to the message, as the object (in other words, the object determination unit <NUM> may determine the content of the object on the basis of the possibility that the object is visually recognized by a different user).

The object determination unit <NUM> provides information associated with the object for which the content is determined to the projection execution unit <NUM>. Note that the method for determining the content of the object by the object determination unit <NUM> is not limited to the above.

The projection execution unit <NUM> is a function configuration that executes projection of an object to the projection surface. More specifically, the projection execution unit <NUM> generates control information that controls projection by the display apparatus <NUM> using information associated with the position where the projection is performed provided from the projection position determination unit <NUM> and information associated with the object provided from the object determination unit <NUM>. Then, the projection execution unit <NUM> transmits the control information as the message via the communication unit <NUM>. Thus, the display apparatus <NUM> can project the object to the projection surface using the control information.

The input unit <NUM> is a function configuration that receives input from the user. More specifically, the input unit <NUM> includes various input devices including a mouse, a keyboard, a touch panel, a button, a switch, or the like, and receives input performed using these input devices. The input unit <NUM> provides the input information to the control unit <NUM>. Note that the input means is not limited to the above.

The sensor unit <NUM> is a function configuration that collects a variety of sensor information related to situations or environments where the user is in, or a state, an action or the like of the user. The type of sensor information the sensor unit <NUM> collects is not particularly limited. Examples of the sensor information collected by the sensor unit <NUM> include information output by any sensor including an acceleration sensor, gyro sensor, a geomagnetic sensor, a barometric sensor, a temperature sensor, a vibration sensor, a heartbeat sensor, a pulse wave sensor, a proximity sensor, an illuminance sensor, a pressure sensor, a sound sensor, a position sensor (e.g., global navigation satellite system (GNSS) sensor), a sweat sensor, a pH sensor, a humidity sensor, an infrared sensor, or the like. Note that the sensor unit <NUM> may collect the sensor information from an external apparatus including these various sensors. The sensor unit <NUM> provides the collected sensor information to the control unit <NUM>.

The imaging unit <NUM> is a function configuration that captures an image of the user or a surrounding environment. More specifically, the imaging unit <NUM> includes an image sensor (e.g., charge-coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor, or the like), and captures an image of the user or a surrounding environment using the sensor. Then, the imaging unit <NUM> provides the generated captured image information to the control unit <NUM>. Note that the aforementioned image includes a moving image in addition to a still image.

The output unit <NUM> is a function configuration that outputs a variety of information. For example, the output unit <NUM> can output a variety of information to, for example, a display means, e.g., a display, or a sound output means, e.g., a speaker or an amplifier. Note that the output means is not limited to the above.

The communication unit <NUM> is a function configuration that performs a variety of communication with the external apparatus including the display apparatus <NUM>. For example, the communication unit <NUM> receives the message or the like from the external apparatus or transmits the control information generated by the projection execution unit <NUM> to the display apparatus <NUM> as the message. Note that the information communicated by the communication unit <NUM> and the case of communication are not limited to the above. Furthermore, the communication method of the communication unit <NUM> is not particularly limited.

The storage unit <NUM> is a function configuration that stores a variety of information. For example, the storage unit <NUM> can store information associated with coordinates of each of points constituting the information processing apparatus <NUM>, the display apparatus <NUM>, and other real objects of an orthogonal coordinate system of a three-dimensional space, information associated with the message transmitted or received by the information processing apparatus <NUM>, information associated with the object to be projected, or the like. Furthermore, the storage unit <NUM> stores various programs, various parameters, or the like used for processing by the information processing apparatus <NUM>. Note that the information stored by the storage unit <NUM> is not limited to the above.

In the above, a functional configuration example of the information processing apparatus <NUM> is described. Note that the aforementioned function configurations described in conjunction with <FIG> are mere examples, and the function configuration of the information processing apparatus <NUM> is not limited to the above examples. For example, the information processing apparatus <NUM> may not necessarily include all the configurations illustrated in <FIG>. Furthermore, the function configuration of the information processing apparatus <NUM> can be flexibly modified depending on the specification or operation.

In the above, a functional configuration example of the information processing apparatus <NUM> is described. Next, a processing example of the information processing apparatus <NUM> is described with reference to <FIG> is a flowchart illustrating a processing example in which the information processing apparatus <NUM> that has received the message from the external apparatus transmits the control information to the display apparatus <NUM> as the message.

In step S1000, the communication unit <NUM> of the information processing apparatus <NUM> receives the message from the external apparatus. In step S1004, the projection surface determination unit <NUM> determines a projection surface that can be visually recognized by the user as a projection target. In step S1008, the projection position determination unit <NUM> determines the position of the projection surface to which projection is performed. In step S1012, the projection execution unit <NUM> uses the information or the like associated with the position to which projection is performed provided from the projection position determination unit <NUM> to generate the control information that controls projection to the display apparatus <NUM>. Then, when the projection execution unit <NUM> transmits the control information as the message via the communication unit <NUM>, a series of processing by the information processing apparatus <NUM> ends. By the above processing, the display apparatus <NUM> can project the object to the projection surface using the control information.

Note that each step of the flowchart illustrated in <FIG> is not necessarily needed to be processed in chronological order along the described order. In other words, each step of the flowchart may be processed in an order that differs from the described order or may be processed in parallel.

In the above, a processing example of the information processing apparatus <NUM> is described. Next, a first modification according to the present example is described. In the above, the projection surface is the display of the display apparatus <NUM>. The first modification is an example related to the case where a region where projection is performed by a projector or the like (hereinafter the "projection region <NUM>") is the projection surface.

More specifically, as illustrated in <FIG>, the projection region <NUM> has an area larger than the display of the display apparatus <NUM> in the above example, and various objects (including a still image, a moving image, or the like) can be projected. Note that the size and shape of the projection region <NUM> are not particularly limited. Furthermore, the projection region <NUM> is not necessarily needed to be provided on a flat surface, but may be provided on an uneven surface, a curved surface, or the like.

Furthermore, the apparatus that projects the object to the projection region <NUM> is also not particularly limited. For example, the information processing apparatus <NUM> may have a function that can project the object to the projection region <NUM>, or the external apparatus, e.g., a projector, that can communicate with the information processing apparatus <NUM> may project the object to the projection region <NUM>. Thereafter, as an example, description is given of the case where the external apparatus, e.g., a projector, that can communicate with the information processing apparatus <NUM> projects the object to the projection region <NUM>.

In the first modification, as illustrated in <FIG>, a recognition region <NUM> is formed within the projection region <NUM>. The recognition region <NUM> indicates a region that can be recognized by the user U1 positioned in front of the projection region <NUM>. In other words, the object that is projected within the projection region <NUM> and within the recognition region <NUM> can be recognized by the user U1. Meanwhile, the object that is projected within the projection region <NUM> but outside the recognition region <NUM> is recognized by the user U1.

The information processing apparatus <NUM> outputs the recognition region <NUM> on the basis of the positional relationship or the like between the projection region <NUM> and the user U1. For example, the information processing apparatus <NUM> may output a region within an intersection line between a sphere having any radius from the central point of the head of the user U1 and the projection region <NUM> as the recognition region <NUM>. Note that the radius of the sphere may be changed properly depending on a separation distance between the user U1 and the projection region <NUM>, a state of the user U1, or the like (e.g., posture, direction of line of sight, eyesight, concentration, or the like).

Furthermore, insofar a region where the object can be recognized by the user U1 is calculated, the method for outputting the recognition region <NUM> is not limited to the above. For example, the method for outputting the recognition region <NUM> may be changed properly depending on the size of the object projected to the projection region <NUM> by the information processing apparatus <NUM> (including, for example, the size of letters included in the object), the shape of a surface where the projection region <NUM> has been formed (e.g., a state of unevenness or the like), the separation distance between the user U1 and the projection region <NUM>, a state of the user U1 or the like (e.g., posture, direction of line of sight, eyesight, concentration, or the like).

Also in the first modification, the information processing apparatus <NUM> controls the projection on the basis of the attribute of the message. The specific examples of the attribute of the message are as described above. Also in the first modification, similar to the aforementioned example, the information processing apparatus <NUM> achieves projection that indicates a direction from the user U1 to the message transmission source apparatus.

More specifically, the information processing apparatus <NUM> recognizes coordinates in which each of points constituting the own apparatus, the user U1, the projection region <NUM>, the recognition region <NUM> and other real objects is located on an orthogonal coordinate system of a three-dimensional space. Then, as illustrated in <FIG>, the information processing apparatus <NUM> calculates intersection P1' obtained when a normal line is drawn from central point P1 of the own apparatus toward a parallel surface passing through the projection region <NUM>. Then, the information processing apparatus <NUM> calculates an intersection P1 in between a straight line, which passes central point C1 of the recognition region <NUM> and the intersection P1', and an end of the recognition region <NUM>. Finally, the information processing apparatus <NUM> projects any object for notifying the user U1 of the message near intersection P1_in (e.g., a position after moving by a predetermined distance from intersection P1' in a direction P1_in_d of intersection P1_in with reference to the vicinity of intersection P1_in).

Note that the information processing apparatus <NUM> provides the control information including information associated with the content of the object and the object projection position to the projector that can communicate with the information processing apparatus <NUM> so as to achieve the aforementioned projection (of course, the information processing apparatus <NUM> itself has a function of the projector).

Thus, the user U1 can intuitively recognize the direction to the information processing apparatus <NUM>, which is a message transmission source apparatus. Therefore, particularly, even in a case where a plurality of apparatuses having a function similar to that of the information processing apparatus <NUM> is present in a limited space such as a house or a facility, the user U1 can intuitively specify the information processing apparatus <NUM> that is a transmission source.

Furthermore, even in a case where the number of users is plural, similar processing may be performed. More specifically, as illustrated in <FIG>, it is assumed that, in addition to the user U1, user U2 is present in a state of being capable of visually recognizing the projection region <NUM>, and a recognition region 220a of the user U1 and a recognition region 220b of the user U2 are formed to be partially overlapped.

Even in such a situation, the information processing apparatus <NUM> calculates the point P1_in with respect to the recognition region 220a of the user U1 and the recognition region 220b of the user U2 so as to be able to project any object for giving a notification of the message in the vicinity of point the P1_in. Thus, not only the user U1 but also the user U2 can intuitively recognize the direction to the information processing apparatus <NUM>, which is a message transmission source apparatus. Note that if the separation distance between the points P1_in corresponding to the recognition region 220a of the user U1 and the recognition region 220b of the user U2 is equal to or less than a predetermined value, the information processing apparatus <NUM> may project a common object to the same position (e.g., in the vicinity of the position of one of the points P1_in, in the vicinity of an intermediate point between the two points P1_in, or the like).

Note that the information processing apparatus <NUM> according to the first modification may determine whether or not to project the object (in particular, in a case where the number of users is plural) or whether or not to perform projection with respect to each user in a case where the number of users is plural. For example, the information processing apparatus <NUM> may determine whether or not to project the object on the basis of the attribute of the message or whether or not to perform projection with respect to each user in a case where the number of users is plural. More specifically, it is assumed that the information processing apparatus <NUM> has determined that when the information processing apparatus <NUM> receives the message, there is no problem even if the message is recognized by either the user U1 or the user U2 on the basis of the attribute of the message. In this case, as illustrated in <FIG>, the information processing apparatus <NUM> projects the object with respect to the recognition region 220a of the user U1 and the recognition region 220b of the user U2.

Meanwhile, it is assumed that the information processing apparatus <NUM> has determined that there is a problem when the message is recognized by the user U1 on the basis of the attribute of the message (e.g., in a case where the message relates to adult content and the user U1 is a minor, or the like). In this case, as illustrated in <FIG>, the information processing apparatus <NUM> may not project the object to the recognition region 220a of the user U1, but may project the object only to the recognition region 220b of the user U2.

Note that the method of determination as to whether or not to project the object or the like is not limited to the above. For example, the information processing apparatus <NUM> may determine whether or not to project the object or the like, for example, on the basis of the content of the message in addition to the attribute of the message. More specifically, the information processing apparatus <NUM> when recognizing the message recognizes the content of the message by analyzing the content of the message. Then, the information processing apparatus <NUM> may determine whether or not to project the object or the like by determining as to whether or not it is appropriate to notify the user of the message. Note that the similar determination processing may be applied to examples other than the first modification.

Furthermore, in the first modification, the number of recognition regions <NUM> of one user may be provided in plural. More specifically, a region that can be recognized by the user without movement of the face or the eyes may be provided as a first recognition region <NUM>, and a region that can be recognized by the user with the movement of the face or the eye may be provided as a second recognition region <NUM>. Then, the information processing apparatus <NUM> may control projection of the object to the first recognition region <NUM> and the second recognition region <NUM>. For example, the information processing apparatus <NUM> may project an object related to a massage having higher priority to the first recognition region <NUM> and may project an object related to a message having a lower priority to the second recognition region <NUM>. Furthermore, the information processing apparatus <NUM> may project the object to the first recognition region <NUM> at a time of start of indication of the object and may move the object to the second recognition region <NUM> after a lapse of predetermined time. There is a possibility that the object that is in a state of being always within the user's field of vision provides a discomfort feeling to the user. However, such a problem can be solved when a plurality of the recognition regions <NUM> is provided to enable proper use.

Here, a functional configuration example of the information processing apparatus <NUM> according to the first modification is described with reference to <FIG>. Note that thereafter for avoidance of duplicate description, only differences with respect to the function configuration example (see <FIG>) of the information processing apparatus <NUM> according to the aforementioned examples are described.

The projection surface determination unit <NUM> according to the first modification is a function configuration that determines the projection region <NUM> where the projection is performed. More specifically, the projection surface determination unit <NUM> determines the projection region <NUM> that can be visually recognized by the user as a projection target. For example, the projection surface determination unit <NUM> analyzes a variety of sensor information provided by the sensor unit <NUM> so as to recognize the position, the posture, the action or the like of the user and output the projection region <NUM> that can be visually recognized by the user on the basis of such information. When the number of the projection regions <NUM> that can be visually recognized by the user is plural, the projection surface determination unit <NUM> outputs an optimum projection region <NUM>. Then, the projection surface determination unit <NUM> provides the determined projection region <NUM> to the projection position determination unit <NUM>. Note that, similar to the aforementioned examples, the method for determining the projection region <NUM> where projection is performed is not limited to the above.

Furthermore, as illustrated in <FIG>, the information processing apparatus <NUM> according to the first modification includes a recognition region output unit <NUM> that is not included in the information processing apparatus <NUM> according to the aforementioned examples. The recognition region output unit <NUM> is a function configuration that outputs the recognition region <NUM> of the projection region <NUM>. For example, the recognition region output unit <NUM> outputs a region within an intersection line between a sphere having any radius from the central point of the head of the user and the projection region <NUM> as the recognition region <NUM>, but the method for outputting the recognition region <NUM> is not limited to this as described above. The recognition region output unit <NUM> provides information associated with the recognition region <NUM> to the projection position determination unit <NUM>.

The projection position determination unit <NUM> is a function configuration that determines the position of the recognition region <NUM> to which projection is performed. More specifically, the projection position determination unit <NUM> outputs the point P1_in of <FIG>. The method for outputting point P1_in is described above and description will be omitted. The projection position determination unit <NUM> provides information associated with the position of the recognition region <NUM> to which projection is performed to the projection execution unit <NUM>. Thus, the projection execution unit <NUM> can project the object to the position. Note that the other function configuration examples are similar to the function configuration examples of the information processing apparatus <NUM> according to the aforementioned examples (see <FIG>).

Note that the aforementioned function configurations described in conjunction with <FIG> are mere examples, and the function configuration of the information processing apparatus <NUM> according to the first modification is not limited to the above examples. For example, the information processing apparatus <NUM> according to the first modification may not necessarily include all the configurations illustrated in <FIG>. Furthermore, the function configuration of the information processing apparatus <NUM> according to the first modification can be flexibly modified depending on the specification or operation.

Next, a processing example of the information processing apparatus <NUM> according to the first modification is described with reference to <FIG> is a flowchart illustrating a processing example in which the information processing apparatus <NUM> according to the first modification that has received the message from the external apparatus transmits the control information to the display apparatus <NUM> as the message.

In step S1100, the communication unit <NUM> of the information processing apparatus <NUM> according to the first modification receives the message from the external apparatus. In step S1104, the projection surface determination unit <NUM> determines the projection region <NUM> that can be visually recognized by the user as a projection target. In step S1108, the recognition region output unit <NUM> outputs the recognition region <NUM> of the projection region <NUM>. In step S1112, the projection position determination unit <NUM> determines the position of the recognition region <NUM> to which projection is performed. In step S1116, the projection execution unit <NUM> uses the information or the like associated with the position to which projection is performed provided from the projection position determination unit <NUM> to generate the control information that controls projection to the display apparatus <NUM>. Then, when the projection execution unit <NUM> transmits the control information as the message via the communication unit <NUM>, a series of processing by the information processing apparatus <NUM> according to the first modification ends. By the above processing, the display apparatus <NUM> can project the object to the recognition region <NUM> using the control information.

In the above, the first modification according to the present example is described. Next, a second modification according to the present example is described. In the first modification, the number of the projection regions <NUM> is one. Meanwhile, the second modification is an example related to a case where the number of the projection regions <NUM> is plural.

More specifically, as illustrated in <FIG>, a projection region 210a and a projection region 210b are present, and the user U1 is present in front of them. Note that, also in the second modification, the size and shape of the projection region <NUM> are not particularly limited. Furthermore, the projection region <NUM> is not necessarily needed to be provided on a flat surface, but may be provided on an uneven surface, a curved surface, or the like. Furthermore, the apparatus that projects the object to the projection region <NUM> is also not particularly limited. Thereafter, as an example, description is given of the case where the external apparatus, e.g., a projector, that can communicate with the information processing apparatus <NUM> projects the object to the projection region <NUM>. Furthermore, in the second modification, because the user U1 can generally recognize the projection region <NUM>, the entire projection region <NUM> is the recognition region <NUM>.

Also in the second modification, the information processing apparatus <NUM> controls the projection on the basis of the attribute of the message. The specific examples of the attribute of the message are as described above. Furthermore, also in the second modification, similar to the aforementioned example, the information processing apparatus <NUM> achieves projection that indicates a direction from the user U1 to the message transmission source apparatus.

More specifically, the information processing apparatus <NUM> recognizes coordinates in which each of points constituting the own apparatus, the user U1, the plurality of projection regions <NUM>, the recognition region <NUM> and other real objects is located on an orthogonal coordinate system of a three-dimensional space.

Then, the information processing apparatus <NUM> determines projection region <NUM> to which the object is projected among the plurality of projection regions <NUM>. More specifically, the information processing apparatus <NUM> determines a projection region <NUM> that can be visually recognized by the user (or that is easier for the user to recognize) among the plurality of projection regions <NUM> as the projection target. For example, information processing apparatus <NUM> analyzes a variety of sensor information provided by the sensor unit <NUM> so as to recognize the position, the posture, the action or the like of the user and output the projection region <NUM> that can be visually recognized by the user on the basis of such information. In the example of <FIG>, the projection region 210b is closer to the user U1 than the projection region 210a. Therefore, the projection region 210b is selected as the projection region <NUM> that can be visually recognized by the user U1 (or that is easier for the user U1 to recognize).

Then, the information processing apparatus <NUM> calculates point P1_in at the projection region <NUM> (strictly, the recognition region <NUM> of the projection region <NUM>) determined as the projection target by the method similar to that of the aforementioned first modification. Finally, the information processing apparatus <NUM> projects an object in a vicinity of point P1_in.

Note that, in the example of <FIG>, the projection region 210a is in a position farther from the user U1. However, the object may be projected to the projection region 210a insofar as it is determined that the user U1 can visually recognize the projection region 210a (or the user U1 can more easily visually recognize the projection region 210a) on the basis of the line of sight or the like of the user U1.

Furthermore, even in a case where the number of users is plural, similar processing may be performed. More specifically, as illustrated in <FIG>, the projection region 210a is present in a state of being capable of being visually recognized by the user U1 and the projection region 210b is present in a state of being capable of being visually recognized by the user U2. Note that the recognition region <NUM> of the user U1 is the entire projection region 210a, and the recognition region <NUM> of the user U2 is the entire projection region 210b.

Even in such a situation, the information processing apparatus <NUM> according to the second modification calculates the point P1_in with respect to the projection region 210a (the recognition region <NUM> of the user U1) and the projection region 210b (the recognition region <NUM> of the user U2) so as to be able to project any object for giving a notification of the message in the vicinity of point the P1 in. Thus, not only the user U1 but also the user U2 can intuitively recognize the direction to the information processing apparatus <NUM>, which is a message transmission source apparatus.

Note that, similar to the first modification, if the separation distance between the points P1_in corresponding to the projection region 210a and the projection region 210b is equal to or less than the predetermined value, the information processing apparatus <NUM> may project a common object to the same position. Furthermore, the information processing apparatus <NUM> may determine whether or not to project the object (particularly in a case where the number of users is plural).

Here, referring to <FIG>, description is given of an example of a case where the second modification described above is applied to an on-vehicle system.

<FIG> is a diagram briefly illustrating the inside of the vehicle in which a direction described as "front" in the drawing is the front side of the automobile and a direction described as "back" is the rear side of the automobile. Furthermore, a side surface window of a front seat (hereinafter called the "front side window") and a side surface window of a rear seat (hereinafter called the "rear side window") of an automobile are the projection regions <NUM> (in the drawing, projection region 210a to projection region 210c are described). Furthermore, smartphones owned by the user U1 to the user U3 function as an information processing apparatus 100a to an information processing apparatus 100c.

Then, for example, each information processing apparatus <NUM>, in a case of receiving the message from the external apparatus, projects the object to the projection region <NUM> (recognition region <NUM>) of each user. Thus, each user can recognize that the information processing apparatus <NUM> has received the message without removing the information processing apparatus <NUM>. Furthermore, when the object is projected to the projection region <NUM> (recognition region <NUM>) of each user, for example, as compared with the case where the object is projected to a predetermined position, e.g., windshield, the recognition of the message by a receiver becomes easier.

At this time, as described above, the information processing apparatus <NUM> can control the content of the object to be projected. For example, a case where the received message is a private message is considered (for example, a case where the destination of the message is only one user or a case where the message transmission source is not known to a different user around. In this case, the information processing apparatus <NUM> may project the content of the message as the object when the object is determined not to be recognized by the different user. Furthermore, the information processing apparatus <NUM> may project an icon (e.g., object O1 or the like of <FIG>) corresponding to the message without projecting the content of the message when it is determined that there is a possibility that the object is recognized by the different user. Furthermore, the information processing apparatus <NUM> may not project the object when it is determined that there is a possibility that the object is recognized by the different user.

Meanwhile, a case where the received message is, for example, a public message that is shared by a certain group (e.g., a group chat, a group talk or the like). In this case, in a case where all users present in the vehicle belong to the group, the information processing apparatus <NUM> may project the content of the message as the object to the projection region <NUM> (recognition region <NUM>) that can be recognized by everyone or may output the content of the message by a sound. Of course, the information processing apparatus <NUM> may project an icon (e.g., object O2-<NUM> to object O2-<NUM> or the like of <FIG>) corresponding to the message without projecting the content of the message. Furthermore, in a case where only some of all the users present in the vehicle belong to the group, the information processing apparatus <NUM> may project the content of the message or the like as the object to the projection region <NUM> (recognition region <NUM>) that can be recognized only by some users or may not project the object.

Note that even in a case of a public message, e.g., a group chat, in a case where the information processing apparatus <NUM> analyzes the message and recognizes that the message contains highly private information (e.g., a case where a user name that is not known to a specific user is contained in the message), the information processing apparatus <NUM> may take a response similar to that to the private message described above.

Furthermore, regarding a function configuration example and a processing example of the information processing apparatus <NUM> according to the second modification, description is omitted because they are similar to the function configuration example and the processing example of the information processing apparatus <NUM> according to the first modification described with reference to <FIG> and <FIG>.

Furthermore, in the above, the information processing apparatus <NUM> indicates a direction from the user to the message transmission source apparatus by the object projection position. However, an aspect of projection is not limited to the above. For example, like object O3 of <FIG>, the information processing apparatus <NUM> may perform projection such that the projection position of the object O3 is fixed and a direction of arrow O3-<NUM> of the object O3 matches a direction to the message transmission source apparatus.

Thus, for example, even in a case where the position of the projection surface or the recognition region <NUM> where the object can be projected is restricted, the information processing apparatus <NUM> can properly indicate a direction from the user to the message transmission source apparatus. Note that <FIG> is also a mere example of projection aspect, and its content can be changed properly.

In the above, the first example according to the present disclosure is described. Next, the second example according to the present disclosure is described. The second example is an example in which a separation distance between the user and the message transmission source apparatus is indicated by object projection control.

For example, in a case where the user waits for arrival of home delivery or food delivery, the user wants to know a separation distance between the user and a courier or the like. Thus, the information processing apparatus <NUM> according to the second example, in a case of receiving the message from the courier or the like, can indicate a separation distance between the user and the message transmission source apparatus by controlling projection on the basis of the attribute of the message.

For example, as illustrated in <FIG>, the information processing apparatus <NUM> projects object O4 that indicates a separation distance between the user and the message transmission source apparatus to a predetermined position of the projection surface of the display apparatus <NUM> (alternatively, the recognition region <NUM> of the projection region <NUM>). The object O4 includes an object O4-<NUM> that indicates a user (or a building, e.g., a house in which the user is present), an object O4-<NUM> that indicates a courier, an object O4-<NUM> that indicates a food delivery courier, and a distance gauge O4-<NUM> that indicates a distance to the user. When the positions of the object O4-<NUM> and the object O4-<NUM> on the distance gauge <NUM>-<NUM> are changed depending on a change of distance to the user, the user can intuitively recognize the relative positional relationship with respect to the courier and the food delivery courier.

Here, in the present example, the method for the information processing apparatus <NUM> to recognize the separation distance between the user and the courier or the like is not particularly limited. For example, when the message transmitted from the courier or the like contains sensor information of a GNSS sensor carried by the courier or the like, the information processing apparatus <NUM> may recognize the separation distance between the user and the courier or the like by analyzing the sensor information. Furthermore, the system of the courier or the like may calculate the separation distance between the user and the courier or the like to contain the information associated with the separation distance into the message such that the information processing apparatus <NUM> recognizes the separation distance between the user and the courier or the like.

Note that, an aspect of projection is not limited to <FIG>. For example, the distance to the user may be indicated by any method, e.g., text (e.g., a numerical value or the like), color, the size of an object, or the like.

Here, a functional configuration example of the information processing apparatus <NUM> according to the second example is described. Note that thereafter for avoidance of duplicate description, only differences with respect to the function configuration example (see <FIG> and <FIG>) of the information processing apparatus <NUM> according to the aforementioned examples are described.

The projection position determination unit <NUM> according to the second example determines an object projection position. More specifically, the projection position determination unit <NUM> recognizes the separation distance between the user and the courier or the like, e.g., by analyzing the received message, to determine the projection position of the object O4-<NUM> and the object O4-<NUM> on the gauge O4-<NUM>. In other words, the projection position determination unit <NUM> changes the projection position of the object O4-<NUM> and the object O4-<NUM> on the distance gauge O4-<NUM> depending on a change of the distance to the user.

Note that, as described above, since an aspect of projection is not limited to <FIG>, in a case where the distance to the user is not indicated by the object projection position, the content of processing by the projection position determination unit <NUM> can be changed properly flexibly. For example, in a case where the distance to the user is indicated by a numerical value, the projection position determination unit <NUM> may recognize the distance to the user and determine the content of a numerical value to be projected (note that, in this case, the determination of a numerical value to be projected may be achieved by the object determination unit <NUM>).

Furthermore, regarding the processing example of the information processing apparatus <NUM> according to the second example, which is similar to the content described with reference to <FIG> and <FIG>, description is omitted. Note that, for example, in step S1008 of <FIG>, the projection position determined by the projection position determination unit <NUM> is the position of the object O4-<NUM> and the object O4-<NUM> on the gauge O4-<NUM> in the example of <FIG>.

Furthermore, as described in the aforementioned example, the information processing apparatus <NUM> can control the projection of the object on the basis of the recognized context. For example, in a case where the user utters "from which direction they come" while waiting for delivery, the information processing apparatus <NUM> may analyze the utterance and recognize the context to switch the method to an object projection method (third example) such that not only the separation distance between the user and the courier, but also a direction from the user to the courier is indicated.

In the above, the second example according to the present disclosure is described. Next, the third example according to the present disclosure is described. The third example is an example in which both a direction from the user to the message transmission source apparatus and a separation distance between the user and the message transmission source apparatus are indicated by object projection control.

For example, in a case where the user is waiting for a moving stall that passes by the home and thinks of going to buy an item when the moving stall passes by the home, the user wants to know both a direction of the moving stall and a distance to the moving stall. Thus, the information processing apparatus <NUM> according to the third example, in a case of receiving the message from the moving stall, can indicate both a direction from the user to the message transmission source apparatus and a separation distance between the user and the message transmission source apparatus by controlling projection on the basis of the attribute of the message.

For example, as illustrated in <FIG>, the information processing apparatus <NUM> projects object O5 that indicates both a direction from the user to the message transmission source apparatus and a separation distance between the user and the message transmission source apparatus to a predetermined position of the projection surface of the display apparatus <NUM> (alternatively, the recognition region <NUM> of the projection region <NUM>). The object O5 includes an object O5-<NUM> that indicates a user (or a building, e.g., a house in which the user is present), an object O5-<NUM> that indicates a moving stall, a concentric circle map O5-<NUM> that indicates a direction of the moving stall and a distance to the moving stall. When the position of the object O5-<NUM> on the concentric circle map O5-<NUM> is changed on the same circle depending on a change in direction from the user to the moving stall, the user can intuitively recognize the direction of the moving stall. Furthermore, when the position of the object O5-<NUM> on the concentric circle map O5-<NUM> is changed to a circle having a smaller radius (or a circle having a larger radius) depending on a change in separation distance between the user and the moving stall, the user can intuitively recognize the distance to the moving stall.

Note that, similar to the second example, the method for the information processing apparatus <NUM> to recognize the direction and the distance to the moving stall is not particularly limited. Furthermore, an aspect of projection is not limited to <FIG>. For example, the distance to the user may be indicated by any method, e.g., text (e.g., a numerical value or the like), color, the size of an object, or the like.

Here, a functional configuration example of the information processing apparatus <NUM> according to the third example is described. Note that thereafter for avoidance of duplicate description, only differences with respect to the function configuration example (see <FIG> and <FIG>) of the information processing apparatus <NUM> according to the aforementioned examples are described.

The projection position determination unit <NUM> according to the third example determines an object projection position. More specifically, the projection position determination unit <NUM> recognizes the direction and the distance to the moving stall, e.g., by analyzing the message received from the moving stall, to determine the projection position of the object O5-<NUM> on the concentric circle map O5-<NUM>.

Note that, as described above, since an aspect of projection is not limited to <FIG>, in a case where the direction and the distance to the moving stall are not indicated by the object position, the content of processing by the projection position determination unit <NUM> can be changed properly flexibly. For example, in a case where the direction and the distance to the moving stall are indicated by a numerical value, the projection position determination unit <NUM> may recognize the direction and the distance to the moving stall and determine the content of a numerical value to be projected (note that, in this case, the determination of a numerical value to be projected may be achieved by the object determination unit <NUM>).

Furthermore, regarding the processing example of the information processing apparatus <NUM> according to the third example, which is similar to the content described with reference to <FIG> and <FIG>, description is omitted. Note that, for example, in step S1008 of <FIG>, the projection position determined by the projection position determination unit <NUM> is the position of the object O5-<NUM> on the concentric circle map O5-<NUM> in the example of <FIG>.

Furthermore, as described in the aforementioned example, the information processing apparatus <NUM> can control the projection of the object on the basis of the recognized context. For example, in a case where the user also orders food delivery while waiting for the moving stall, the information processing apparatus <NUM> may switch to the method (second example) for projecting the object to indicate the separation distance between the user and the moving stall and the food delivery courier by recognizing the context and determining that the separation distance between the user and the moving stall or the food delivery courier is more important than the direction of the moving stall or the food delivery courier.

In the above, the third example according to the present disclosure is described. Next, a hardware configuration example of the information processing apparatus <NUM> is described with reference to <FIG>.

<FIG> is a diagram illustrating a hardware configuration of the information processing apparatus <NUM>. The information processing apparatus <NUM> includes a central processing unit (CPU) <NUM>, a read only memory (ROM) <NUM>, a random access memory (RAM) <NUM>, a host bus <NUM>, a bridge <NUM>, an external bus <NUM>, an interface <NUM>, an input apparatus <NUM>, an output apparatus <NUM>, a storage apparatus (HDD) <NUM>, a drive <NUM>, and a communication apparatus <NUM>.

The CPU <NUM> functions as an arithmetic processing apparatus and a control apparatus and controls general operations in the information processing apparatus <NUM> according to various programs. Furthermore, the CPU <NUM> may be a microprocessor. The ROM <NUM> stores a program, an arithmetic parameter, or the like the CPU <NUM> uses. The RAM <NUM> temporarily stores a program used in execution of the CPU <NUM>, a parameter that properly changes in the execution, or the like. They are interconnected by the host bus <NUM> including a CPU bus or the like. Cooperation between the CPU <NUM>, the ROM <NUM>, and the RAM <NUM> achieves each function of the control unit <NUM>, the sensor unit <NUM>, or the imaging unit <NUM> of the information processing apparatus <NUM>.

The host bus <NUM> is connected to the external bus <NUM>, e.g., a peripheral component interconnect/interface (PCI) bus via the bridge <NUM>. Note that it is not necessarily needed to separately configure the host bus <NUM>, the bridge <NUM>, and the external bus <NUM>, and these functions may be mounted on a single bus.

The input apparatus <NUM> includes an input means for the user to input information, e.g., a mouse, a keyboard, a touch panel, a button, a microphone, a switch, and a lever, and an input control circuit that generates an input signal on the basis of the input by the user and outputs the input signal to the CPU <NUM>, or the like. A person who uses the information processing apparatus <NUM> can input a variety of information or gives an instruction of processing operation to each apparatus by operating the input apparatus <NUM>. The function of the input unit <NUM> is achieved by the input apparatus <NUM>.

The output apparatus <NUM> includes a display apparatus, for example, a cathode ray tube (CRT) display apparatus, a liquid crystal display (LCD) apparatus, an organic light emitting diode (OLED) apparatus, and a lamp. Moreover, the output apparatus <NUM> includes a sound output apparatus, e.g., a speaker, a headphone, or the like. The output apparatus <NUM> outputs, for example, reproduced content. Specifically, the display apparatus displays a variety of information including reproduced video data by text or image. Meanwhile, the sound output apparatus converts reproduced sound data or the like into a sound and outputs the sound. The function of the output unit <NUM> is achieved by the output apparatus <NUM>.

The storage apparatus <NUM> is an apparatus for data storage. The storage apparatus <NUM> may include a storage medium, a record apparatus that records data on the storage medium, a read apparatus that reads data from the storage medium, a removal apparatus that removes data recorded on the storage medium, or the like. The storage apparatus <NUM> includes, for example, a hard disk drive (HDD). The storage apparatus <NUM> drives a hard disk and a program or various data the CPU <NUM> executes. Each function of the storage unit <NUM> is achieved by the storage apparatus <NUM>.

The drive <NUM> is a storage medium reader/writer, and is mounted on the information processing apparatus <NUM> internally or externally. The drive <NUM> reads information recorded on a removable storage medium <NUM>, e.g., a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, which is mounted, and outputs the information to the RAM <NUM>. Furthermore, the drive <NUM> can write information onto the removable storage medium <NUM>.

The communication apparatus <NUM> is, for example, a communication interface including a communication device or the like for connection to a communication network <NUM>. Each function of the communication unit <NUM> is achieved by the communication apparatus <NUM>.

As described above, the information processing apparatus <NUM> according to the present disclosure controls the projection of the object that notifies the user of the message on the basis of the attribute of the message. Thus, the information processing apparatus <NUM> can indicate the direction from the user to the message transmission source apparatus or the separation distance between the user and the message transmission source apparatus, to the user. Furthermore, the information processing apparatus <NUM> can further control the projection of the object on the basis of the context. Moreover, the information processing apparatus <NUM> can control the content of the object depending on the attribute of the message or the like.

It is apparent that a person skilled in the art of the present disclosure may find various alterations and modifications within the technical scope of the appended claims, and it should be understood that they will naturally come under the technical scope of the present disclosure.

Claim 1:
An information processing apparatus comprising:
a control unit (<NUM>) configured to
acquire a message from a message transmission source apparatus,
control projection of an object notifying a user of the message on a basis of an attribute of the message,
control the projection to an external projection surface, and
indicate a relative positional relationship between the user and the message transmission source apparatus for the message by the projection,
characterized in that
the control unit (<NUM>) is configured to indicate a direction from the user to the message transmission source apparatus by the projection of the object, a position of the projected object on the projection surface indicating the direction and
indicate, based on a recognized context related to the user, a separation distance between the user and the message transmission source apparatus by the projection.