IDENTIFICATION SYSTEM, IDENTIFICATION METHOD, AND STORAGE MEDIUM

The identification system includes: an acquisition circuit that, on the basis of laser light illuminated onto respective positions in a space of interest including the stationary structure, and reflected light of the laser light, acquires position information corresponding to the respective positions and wavelength information based on the wavelength of the reflected light reflected at the respective positions; an identification circuit that identifies an abnormal location among the positions where an abnormality with respect to the stationary structure is occurring, on the basis of the wavelength information; and a monitor that monitors the abnormal location.

TECHNICAL FIELD

The present invention relates to, for example, an identification system that enables monitoring of a stationary structure.

BACKGROUND ART

A technique for monitoring a structure by using Light Detection and Ranging (LiDAR) is known. For example, a technique described in PTL 1 detects whether an abnormality occurs on a structure by detecting a vibration speed of the structure by using LiDAR. It is noted that a technique described in PTL 2 is also known as a related technique. Furthermore, as another related technique, a technique described in PTL 3 is also known.

CITATION LIST

Patent Literature

SUMMARY OF INVENTION

Technical Problem

In general, when an abnormality occurs in a part of a structure that is supposed to be stationary (hereinafter referred to as a “stationary structure”), such a part may be in motion. For example, a part of a surface member of a stationary structure may be peeled off, and the peeled-off surface member may hang down and sway. In monitoring of a stationary structure, it is required not only to detect an event of occurrence of such an abnormality, but also to identify a location where such an abnormality occurs (hereinafter referred to as “abnormality occurrence location”).

However, in the technique described in PTL 1, only presence or absence of abnormality in a structure is detected, and means for identifying the abnormality occurrence location is not provided. Therefore, with the technique described in PTL 1, it is difficult to identify the abnormality occurrence location. As a result, for example, there is a problem that it is difficult to achieve monitoring of an abnormality occurrence location.

In view of the above-mentioned problem, an object of the present invention is to achieve identification of an abnormal location where an abnormality occurs in a stationary structure.

Solution to Problem

The present invention is an identification system including:an acquisition means for acquiring, based on laser light emitted to each position within a target space including a stationary structure and reflected light of the laser light, position information according to the each position and wavelength information based on a wavelength of the reflected light reflected at the each position;an identification means for identifying, based on the wavelength information, an abnormal portion where an abnormality occurs in the stationary structure from the positions; anda monitoring means for monitoring the abnormal portion.

The present invention is an identification method including:acquiring, based on laser light emitted to each position within a target space including a stationary structure and reflected light of the laser light, position information according to the each position and wavelength information based on a wavelength of the reflected light reflected at the each position;identifying, based on the wavelength information, an abnormal portion where an abnormality occurs in the stationary structure from the positions; andmonitoring the abnormal portion.

The present invention is a storage medium storing a program that causes an information processing apparatus to execute:processing of acquiring, based on laser light emitted to each position within a target space including a stationary structure and reflected light of the laser light, position information according to the each position and wavelength information based on a wavelength of the reflected light reflected at the each position;processing of identifying, based on the wavelength information, an abnormal portion where an abnormality occurs in the stationary structure from the positions; andprocessing of monitoring the abnormal portion.

Advantageous Effects of Invention

According to the present invention, an identification system and the like that can realize identify an abnormal portion where an abnormality occurs in a stationary structure can be provided.

EXAMPLE EMBODIMENT

First Example Embodiment

An identification system1according to the first example embodiment is explained with reference toFIG.1,FIG.2,FIG.3,FIG.4, andFIG.5.FIG.1is a block diagram illustrating a configuration example of the identification system1.FIG.2,FIG.3, andFIG.4are diagrams for explaining details of the identification system1.FIG.5is a flowchart for explaining an example of operations of the identification system1.

The configuration of the identification system1is explained. The identification system1includes a light source unit10and an identification apparatus20. InFIG.1, the light source unit10and the identification apparatus20are provided separately, but may be provided integrally. The light source unit10and the identification apparatus20can communicate with each other.

The light source unit10includes light emission means11and light receiving means13.

The light emission means11irradiates a light emission area300including a target space200in which a stationary structure400is arranged with a laser light. Specifically, the laser light is a pulsed laser light. For example, the light emission means11emits laser light from an optical input/output terminal OI provided in the light source unit10, as illustrated inFIG.2,FIG.3, andFIG.4. As a result, the emitted laser light propagates along an optical path OP and enters a reflection point RP of the target object that is present in the target space200. The optical path OP is a line segment connecting the optical input/output terminal OI and the reflection point RP. In this case, the target space is a land that includes the stationary structure400such as a building. Note that stationary structures400include a steel tower, a bridge, a utility pole, and the like.

Further, the light receiving means13receives the laser light reflected by the stationary structure400within the target space200. Hereinafter, the “laser light reflected by the stationary structure400in the target space200” is referred to as “laser reflected light”. For example, in the examples ofFIG.2,FIG.3andFIG.4, the light receiving means13receives the laser reflected light from the reflection point RP of the stationary structure400through the optical path OP and the optical input/output terminal OI. Furthermore, by changing the direction in which the light source unit10emits the laser light as described later, the light receiving means13can receive laser reflected light from different reflection points RP.

The acquisition means21is explained. The acquisition means21acquires position information corresponding to each position irradiated with the laser light, based on the laser light and laser reflected light. Furthermore, the acquisition means21acquires wavelength information corresponding to the wavelength of the laser reflected light reflected at each position irradiated with the laser light, based on the laser reflected light. In this case, the laser reflected light refers to the reflected light of the laser light emitted to each position of the target space200including the stationary structure400.

In this case, position information is explained with reference toFIG.2,FIG.3, andFIG.4.FIG.2illustrates positional relationship between the light source unit10and the target space200along x, y, and z axes. Furthermore,FIG.3illustrates the positional relationship between the light source unit10and the target space200along the z-axis and the a-axis. The a-axis is acquired by orthogonally projecting the optical path OP onto the xy plane.

By tilting the light source unit10alongα direction (vertical direction with respect to the xy plane) illustrated inFIG.2, the light emission means11can emit laser light at a given angle θ1as illustrated inFIG.3. For example, as illustrated inFIG.3, the angle θ1is an angle formed by a straight line extending vertically downward from the optical input/output terminal OI of the laser light and the optical path OP. The acquisition means21can detect the angle θ1using a gyro sensor (not illustrated) or the like.

The acquisition means21calculates the length of the optical path OP from the time from when the laser light is emitted by the light emission means11until the laser reflected light is received by the light receiving means13. Hereinafter, “a time until the laser reflected light is received by the light receiving means13” is referred to as a “time t”. Specifically, the length of the optical path OP is found by multiplying the time t by the speed of light and dividing the acquired value by two. The acquisition means21can calculate a difference between the z-coordinate of the optical input/output terminal OI of the laser light and the z-coordinate of the reflection point RP of the laser light (H1inFIG.3) by multiplying the length of the optical path OP by cos θ1. Accordingly, the acquisition means21acquires the relative position of the reflection point RP on the z-axis with respect to the optical input/output terminal OI.

Furthermore, the acquisition means21calculates the length of the line segment D1of the optical path OP projected onto the xy plane by multiplying the length of the optical path OP by sin θ1. As illustrated inFIG.4, the line segment D1is a line segment that connects the optical input/output terminal OI of the laser light to the reflection point RP on the xy plane.

By tilting the light source unit10along β direction (parallel to the xy plane) illustrated inFIG.2, the light emission means11can emit laser light at any given angle θ2. For example, the angle θ2is an angle formed by a reference line L set on the xy plane and the optical path OP, as illustrated inFIG.4. In the example illustrated inFIG.4, the reference line L is one of the sides forming the outer periphery of the target space200. The acquisition means21can detect the angle θ2using a gyro sensor (not illustrated) or the like.

The acquisition means21calculates a difference between the x-coordinate of optical input/output terminal OI and the x-coordinate of the reflection point RP (D2inFIG.4) by multiplying the length of line segment D1by sin θ2. The acquisition means21also calculates a difference between the y-coordinate of the optical input/output terminal OI and the y-coordinate of the reflection point RP (D3inFIG.4) by multiplying the length of the line segment D1by cos θ2. As a result, the acquisition means21acquires the relative position on the x-axis and the relative position on the y-axis of the reflection point RP with respect to the optical input/output terminal OI. The acquisition means21stores the acquired relative positions on the respective axes in association with the angles θ1and θ2.

By changing at least one of the angles θ1and θ2by the light source unit10, the laser light is incident on the reflection point RP at a different position. The light source unit10receives the reflected laser light from plurality of reflection points RP within the light emission area300by emitting laser light according to plurality of angles θ1and plurality of angles θ2defined in advance. Thereby, the acquisition means21can acquire the relative positions on the respective axes for each of the plurality of reflection points RP in the target space200. The acquisition means21acquires the relative positions on the respective axes of each of the reflection points RP acquired as described above as position information. Note that the acquisition means21may convert the relative positions into absolute positions using a predetermined reference point, and acquire the absolute positions as position information.

Next, wavelength information is explained. The wavelength information is information that indicates the difference between the wavelength of laser light and the wavelength of laser reflected light. When the laser light enters the moving reflection point RP, the wavelength of the reflected laser light changes due to the Doppler effect. That is, the wavelength information is information indicating the amount of wavelength shift due to the Doppler effect.

The light receiving means13detects the wavelength of the laser reflected light by coherently detecting the laser reflected light using local light having the same wavelength as the laser light. When the light receiving means13receives the reflected light from the reflection point RP, the light receiving means13notifies the acquisition means21of the wavelength of the reflected light. Furthermore, the acquisition means21stores in advance the wavelength of the laser light emitted by the light emission means11. Thereby, the acquisition means21can acquire the wavelength information according to the wavelength of the reflected light. The acquisition means21outputs the position information and the wavelength information, which are acquired, to the identification means22.

The identification means22identifies, based on the wavelength information, an abnormal portion where an abnormality with respect to the stationary structure has occurred among the positions corresponding to the position information.

Specifically, the identification means22identifies, among the positions according to the position information, a position of reflection of the reflected light of which the wavelength is equal to or more than a threshold away from the wavelength of the laser light, as an abnormal portion where an abnormality with respect to the stationary structure400has occurred. Generally, in a case where damage occurs to the stationary structure400such as a steel tower, the damaged portion is likely to shake due to wind or vibration. Therefore, the wavelength of the light reflected by the damaged portion changes due to the Doppler effect. Accordingly, the identification means22can identify the position of reflection of the reflected light of which the wavelength is equal to or more than a threshold away from the wavelength of the laser light, as an abnormal portion where an abnormality has occurred with the stationary structure400. The identification means22outputs information indicating the position of the abnormal portion to an external apparatus such as a display, a speaker, or other information processing apparatuses.

Furthermore, the identification means22may identify whether the position is an abnormal portion based on the wavelength information corresponding to the wavelength of the reflected light reflected at the same position at different times. Specifically, the acquisition means21acquires first wavelength information. In this case, the first wavelength information is wavelength information corresponding to the wavelength of the reflected light reflected at the first position among respective positions. Also, the acquisition means21acquires second wavelength information. In this case, the second wavelength information is wavelength information corresponding to the wavelength of the reflected light reflected at the first position after acquiring the first wavelength information. Then, the identification means22identifies whether the first position is an abnormal portion based on the difference between the first wavelength information and the second wavelength information.

The first wavelength information and the second wavelength information both refer to the amount of wavelength shift due to the Doppler effect. That is, the difference between the first wavelength information and the second wavelength information indicates the amount of change in the amount of wavelength shift due to the Doppler effect. The identification means22can detect that the moving speed at the first position is changing based on the difference between the first wavelength information and the second wavelength information. As explained above, in a case where damage occurs to the stationary structure400such as a steel tower, the damaged portion is likely to shake due to wind and vibration. Therefore, the amount of wavelength shift due to the Doppler effect in the light reflected by the damaged portion is different from that of the light reflected by the same portion before the damage occurred. Therefore, for example, in a case where the amount of change in the amount of wavelength shift exceeds a threshold value, the identification means22can identify that the position where the laser light is reflected is an abnormal portion, based on the wavelength information (the amount of wavelength shift) corresponding to the wavelength of the reflected light that is reflected at the same location at different times.

The three-dimensional model generating means23may perform three-dimensional model generation of the target space200using position information. The three-dimensional model is a collection of points whose positions are uniquely determined by the x-axis coordinates, y-axis coordinates, and z-axis coordinates. The three-dimensional model is, for example, a three-dimensional point cloud model. The three-dimensional model generating means23generates a model indicating the shape of the stationary structure400in the target space200by plotting plurality of reflection points RP on the three-dimensional model, based on the relative positions of the reflection points RP with respect to an optical input/output terminal O1. The relative positions of the reflection points RP with respect to the optical input/output terminal O1are acquired by the acquisition means21.

The monitoring means24monitors the abnormal portion identified by the identification means22. Specifically, for example, the three-dimensional model generating means23continuously performs the process of generating point cloud data. The monitoring means24generates the three-dimensional model of the stationary structure400using the generated point cloud data. That is, such a three-dimensional model is generated in so-called “real time”. The monitoring means24displays an image including the generated three-dimensional model on a display (not illustrated). As a result, monitoring of the stationary structure400is realized.

At this time, the monitoring means24makes an aspect (for example, color) of the portion corresponding to the abnormality occurrence portion in the three-dimensional model different from an aspect (for example, color) of the other portion in the three-dimensional model. As a result, in monitoring the stationary structure400, intensive monitoring of the abnormality occurrence portion can be realized. As a result, accurate monitoring of the abnormality occurrence portion is realized.

In addition to continuously executing the process of generating point cloud data, the three-dimensional model generating means23may also continuously execute the process of measuring the moving speed. The speed of movement is determined from the amount of wavelength shift due to the Doppler effect. The monitoring means24may vary the aspect (for example, color) of the abnormality occurrence portion in the three-dimensional model depending on the moving speed of the corresponding point in the point cloud data, based on the results of such measurement. This enables more detailed monitoring of the abnormality occurrence portion.

Note that in the above example, the monitoring means24monitors the abnormal portion using point cloud data, but the monitoring means24may perform monitoring using a method that does not use point cloud data. Specifically, the monitoring means24may perform monitoring by continuing to extract, to the outside, only position information identified as an abnormal portion from among the position information corresponding to each point in the target space200.

Next, an example of operations of the identification system1is explained with reference toFIG.5.

The light source unit10adjusts the emission angle of the laser light (S101). For example, the light source unit10adjusts the angle θ1illustrated inFIG.3and the angle θ2illustrated inFIG.4to predetermined angles.

The light emission means11of the light source unit10emits laser light (S102). As a result, the laser light is reflected at the reflection point RP of the stationary structure400.

The light receiving means13of the light source unit10receives laser reflected light (S103). At this time, in a memory (not illustrated) provided in the identification apparatus20, a time t from when the laser light is emitted to when the reflected laser light is received is stored in association with the emission angle of the laser light. In this case, the light source unit10stores the intensity of the reflected laser light in addition to the time t.

The light source unit10determines whether the laser light is emitted within a predetermined angle range (S104).

In a case where the laser light is not emitted within the predetermined angle range (No in S104), the light source unit10adjusts the emission angle of the laser light (S101). For example, the light source unit10changes at least one of the angle θ1illustrated inFIG.3and the angle θ2illustrated inFIG.4.

In a case where the laser light is emitted in the predetermined angle range (Yes in S104), the acquisition means21acquires, based on laser reflected light, position information corresponding to each position irradiated with laser light and the wavelength information based on the wavelength of reflected light reflected at each position (S105).

The three-dimensional model generating means23performs three-dimensional model generation of target space200using position information (S106). The identification means22identifies an abnormal portion where an abnormality occurs with respect to the stationary structure400in the target space200based on the position information and the wavelength information (S107). The monitoring means24performs monitoring of the abnormal portion (S108).

The identification system1has been hereinabove explained. In the identification system1, the acquisition means21acquires, based on the reflected light of the laser light emitted to each position in the target space200including the stationary structure400, the position information corresponding to each position and the wavelength information based on the wavelength of the reflected light reflected at each position. In addition, the identification means22identifies, based on the wavelength information, an abnormal portion where an abnormality has occurred with the stationary structure400from among the positions irradiated with the laser light. Additionally, the monitoring means24performs monitoring of the abnormal portion. As described above, the identification system1can identify abnormality occurrence locations with respect to stationary structures. As a result, according to identification system1, monitoring of abnormality occurrence locations with respect to stationary structures can be realized.

A first modified example embodiment of the identification system1according to the first example embodiment is explained. Similar to the identification system1, the first modified example embodiment of the identification system1includes a light source unit10and an identification apparatus20. The light source unit10includes light emission means11and light receiving means13. The identification apparatus20includes acquisition means21, identification means22, three-dimensional model generating means23, and monitoring means24.

The first modified example embodiment of the identification system1differs from the identification system1in that the identification means22performs an additional process. In the first modified example embodiment, the identification means22identifies that there is a possibility that there is an intruder into the stationary structure.

Specifically, as described above, the identification means22identifies a particular position within the target space200as an abnormal portion. Hereinafter, “the particular position within the target space200” is referred to as a “second position”. After the identification means22identifies the second position as an abnormal portion, the identification means22identifies, as an abnormal portion, a position adjacent to the second position from among the positions in the target area. Hereinafter, “the position adjacent to the second position from among the positions within the target area” is referred to as a “third position”. In this case, the identification means22identifies that there is a possibility that there is an intruder into the stationary structure400.

For example, it is assumed that by repeating the process of S107described above, the identification means22identifies the second position as an abnormal portion and then identifies the third position as an abnormal portion. In this case, the identification means22compares the second position and the third position. The identification means22identifies that there is a possibility that there is an intruder into the stationary structure400in a case where the distance between the second position and the third position is less than a predetermined value.

In a case where there is an intruder into the stationary structure400, there is a high possibility that the intruder is moving within target space200. In this case, the intruder is a moving object that is present at adjacent positions at different times. The identification means22is able to identify the position of the moving object as the abnormal portion using the wavelength information based on the wavelength of reflected light. Therefore, the identification means22can identify that there is a possibility that there is an intruder into the stationary structure400in a case where the second position and third position, which are located within a predetermined distance from each other, are identified as abnormal portions at different times.

A second modified example embodiment of the identification system1according to the first example embodiment is explained. Similar to the identification system1, the second modified example embodiment of the identification system1includes a light source unit10and an identification apparatus20. The light source unit10includes light emission means11and light receiving means13. The identification apparatus20includes acquisition means21, identification means22, three-dimensional model generating means23, and monitoring means24.

The second modified example embodiment of the identification system1differs from the identification system1in that the identification means22performs an additional process. In the second modified example embodiment, the identification means22identifies that there is an object that approaches the stationary structure.

Specifically, as described above, the identification means22identifies a particular position within the target space200as an abnormal portion. Hereinafter, “the particular position within the target space200” is referred to as “a fourth position”. The identification means22identifies a fourth position as an abnormal portion, and then identifies a position closer to the position of the stationary structure400than the fourth position as an abnormal portion. Hereinafter, “the position closer to the position of the stationary structure400than the fourth position after the fourth position is identified as the abnormal portion” is referred to as a “fifth position”. In this case, the identification means22identifies that there is an object that approaches the stationary structure400.

For example, it is assumed that by repeating the process of S107described above, the identification means22identifies the fourth position as an abnormal portion and then identifies the fifth position as an abnormal portion. In this case, the identification means22compares the distance from the fourth position to the position of the stationary structure400and the distance from the fifth position to the position of the stationary structure400. Then, the identification means22identifies that there is an object that approaches the stationary structure400in a case where the distance from the fifth position to the position of the stationary structure400is shorter. It is assumed that the position of the stationary structure400is given to the identification system1in advance by the user or the like.

In a case where there is an object (such as a vehicle) that approaches the stationary structure400, there is a high possibility that the approaching object is moving in the direction approaching the stationary structure400within the target space200. Therefore, the identification means22can identify that there is an object that approaches the stationary structure400, in a case where the identification means22identifies, after identifying the fourth position as an abnormal portion, the fifth position, which is closer to the position of the stationary structure400than the fourth position, as an abnormal portion.

A third modified example embodiment of the identification system1according to the first example embodiment is explained. Similar to the identification system1, the third modified example embodiment of the identification system1includes a light source unit10and an identification apparatus20. The light source unit10includes light emission means11and light receiving means13. The identification apparatus20includes acquisition means21, identification means22, three-dimensional model generating means23, and monitoring means24.

The third modified example embodiment of the identification system1differs from the identification system1in that the identification means22performs an additional process. In the third modified example embodiment, the identification means22identifies that an abnormality continuously occurs on the stationary structure.

Specifically, the identification means22identifies a particular position within the target space200as an abnormal portion. Hereinafter, “the particular position within the target space200” is referred to as a “sixth position”. The identification means22identifies the sixth position as an abnormal portion, and then identifies the sixth position as an abnormal portion again. In this case, it is identified that an abnormality is continuously occurring on the stationary structure400at the sixth position.

Second Example Embodiment

An identification system2according to the second example embodiment is explained with reference toFIG.6andFIG.7.FIG.6is a block diagram illustrating a configuration example of the identification system2.FIG.7is a flowchart illustrating an example of operations of the identification system2.

As illustrated inFIG.6, the identification system2includes acquisition means21, identification means22, and monitoring means24. It is assumed that the light source unit10(not illustrated) is provided outside the identification system2, and that communication with the identification system2is possible. The acquisition means21, the identification means22, and the monitoring means24of the identification system2may have functions and connection relationships similar to the acquisition means21, the identification means22, and the monitoring means24of the identification system1.

The acquisition means21acquires position information corresponding to each position based on the reflected light of the laser light emitted to each position in the target space including the stationary structure. The acquisition means21also acquires the wavelength information based on the wavelength of reflected light reflected at each position.

The identification means22identifies, based on the wavelength information, the abnormal portion where an abnormality has occurred with respect to the stationary structure from among the positions. Additionally, the monitoring means24monitors the abnormal portion identified by the identification means22.

Next, an example of operations of the identification system2is explained with reference toFIG.7. The example of the operations below corresponds to an identification method. Furthermore, a storage medium may store a program for causing an information processing apparatus to execute processes of the example of the operations below.

The acquisition means21acquires the position information corresponding to each position in the target space and the wavelength information based on the wavelength of the reflected light reflected at each position (S201).

The identification means22identifies, based on the wavelength information, an abnormal portion where an abnormality has occurred with respect to the stationary structure from among the positions (S202).

The monitoring means24performs monitoring of the abnormal portion (S203).

The identification system2has been hereinabove explained. In the identification system2, the acquisition means21acquires, based on the reflected light of the laser light emitted to each position in the target space including the stationary structure, position information corresponding to each position and the wavelength information based on the wavelength of reflected light reflected at each position. Furthermore, the identification means22identifies, based on the wavelength information, an abnormal portion where an abnormality has occurred with respect to the stationary structure from among the positions irradiated with laser light. Additionally, the monitoring means24performs monitoring of the abnormal portion.

Generally, in a case where a stationary structure such as a steel tower is damaged, the damaged portion is likely to shake due to wind or vibration. Therefore, the wavelength of the light reflected by the damaged portion changes due to the Doppler effect. Accordingly, the identification means22can identify the abnormal portion where an abnormality occurs with respect to the stationary structure400on the basis of the wavelength information based on the wavelength of the reflected light reflected at each position. As described above, the identification system2can identify abnormality occurrence locations with respect to stationary structures. As a result, according to identification system2, monitoring of abnormality occurrence locations with respect to stationary structures can be realized.

Further, some or all of the constituent elements of each apparatus or system is realized by an arbitrary combination of an information processing apparatus2000and a program as illustrated inFIG.8, for example.FIG.8is a diagram illustrating an example of an information processing apparatus that implements the identification systems1,2, and the like. The information processing apparatus2000includes the following configuration, for example.Central Processing Unit (CPU)2001Read Only Memory (ROM)2002Random Access Memory (RAM)2003program2004loaded to RAM2003Storage device2005storing program2004Drive device2007reading and writing recording medium2006Communication interface2008connecting to communication network2009Input and output interface2010for inputting and outputting dataBus2011connecting constituent elements

The constituent elements of each apparatus according to each example embodiment is realized by the CPU2001acquiring and executing the program2004that realizes these functions. The program2004that realizes the functions of the constituent elements of each apparatus is stored in advance in the storage device2005or RAM2003, for example, and is read out by the CPU2001as needed. It should be noted that the program2004may be supplied to the CPU2001via the communication network2009, or may be stored in the recording medium2006in advance, and the drive device2007may read out the program and supply it to the CPU2001.

There are various modified example embodiments for the implementation method of each apparatus. For example, each apparatus may be realized by any combination of a separate information processing apparatus2000and a program for each constituent element. Furthermore, plurality of constituent elements included in each apparatus may be realized by an arbitrary combination of one information processing apparatus2000and a program.

In addition, some or all of the constituent elements of each apparatus are realized by general-purpose or dedicated circuitry, including a processor, or a combination thereof. These may be composed of a single chip or plurality of chips connected via a bus. Some or all of the constituent elements of each apparatus may be realized by a combination of the above-mentioned circuitry and the like and a program.

In a case where some or all of the constituent elements of each apparatus is realized by plurality of information processing apparatuses, circuitry, and the like, the plurality of information processing apparatuses, circuitry, and the like may be centrally located or distributed. For example, the information processing apparatuses, circuitry, and the like may be realized as a client-and-server system, a cloud computing system, and the like, in which each is connected via a communication network.

Some or all of the above example embodiments may be described as in the following Supplementary Notes, but are not limited thereto.

REFERENCE SIGNS LIST