Video display system, video display method, and computer-readable medium

An image capturing system that records on a video recording unit a video captured by an image capturing apparatus and displays the video thus captured on a display unit comprises a change recording unit that records information of the time when, and the region where, a change of status occurs when the change detection unit detects such a change of status, and an extraction unit that extracts a partial region of video from the video thus recorded for displaying on the display unit. The extraction unit switches the video that is displayed on the display unit by extracting a video of the region of the change of status when the imaging time of the video that is displayed on the display unit reaches a time before a time prior to change that is preset, from the time when the change of status occurs.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a video display system, a video display method, and a computer-readable medium, for example, for extracting a portion of a region of a video from a video obtained from a camera apparatus, and displaying the extracted video segment on a terminal device that is on a network. The present invention is particularly suitable for use in displaying the video region when a change of status occurs in a vicinity of the camera apparatus.

2. Description of the Related Art

A network camera system exists that uses an Internet technology to display a video, on a terminal device such as a personal computer, that is imaged by a camera in real time, via a network, while controlling, via the terminal device, an imaging angle of the camera.

A conventional monitoring system would have a preset imaging angle, and would automatically change the imaging angle to another angle in response to a sensor being triggered.

An image delivery system that uses a wide-angle image exists wherein a user is able to switch to viewing an extraction position within the wide-angle image, when the wide-angle image is imaged in a pre-arranged condition that is good for such an imaging purpose, such as a tourist site; refer to Japanese Patent Laid-Open No. 2000-132673.

A method such as the conventional monitoring system, however, which changes the imaging direction of the camera when recording in response to the sensor being triggered, is only capable of verifying the video from the sensor being triggered when verifying the recorded video in playback. Consequently, it has not been possible to verify a video of the region wherein the sensor is triggered prior to the sensor being triggered.

SUMMARY OF THE INVENTION

According to an embodiment of the present invention, an imaging system is offered that allows verifying a video of image wherein a change of status occurs prior to the change of status when verifying the recorded video in playback.

According to one aspect of the present invention, there is provided a video displaying system adapted to display a video obtained from a camera apparatus on a terminal device, the system comprising:

a video recording unit adapted to record the video obtained from the camera apparatus and an imaging time of the camera apparatus;

a change recording unit adapted to record information on a time when a change of status occurs and a region of a change of status within the video obtained from the camera apparatus;

an extraction unit adapted to extract a video in the region of a change of status from the video recorded on the recording unit; and

a display unit adapted to display the video in the region of a change of status extracted from the recorded video on the terminal device, when the imaging time of the video played back on the terminal device reaches a preset time prior to change.

Also, according to another aspect of the present invention, there is provided a video display method adapted to extract and display a video of a partial region obtained from a camera apparatus on a display unit, the video display method comprising the steps of:

recording the video obtained from the camera apparatus, and an imaging time of the camera apparatus, on a video recording unit;

recording on a change recording unit, when a change of status is detected in a vicinity of the camera apparatus, information on a time when a change of status occurs and a region of the change of status within the video obtained from the camera apparatus;

extracting a video in the region of a change of status from the video recorded on the recording unit; and

displaying the video in the region of a change of status extracted from the recorded video on the terminal device, when the imaging time of the video played back on the terminal device reaches a preset time prior to change.

Furthermore, according to another aspect of the present invention, there is provided a terminal device for displaying a video obtained from a camera apparatus, comprising:

a reception unit adapted to receive a video recorded on a video recording unit; and

a processing unit adapted to process a display of the video in the region of a change of status extracted from the recorded video on the terminal device, when the imaging time of the video played back reaches a preset time prior to the change.

DESCRIPTION OF THE EMBODIMENTS

First Embodiment

Following is a description of a network camera system according to a first embodiment of the present invention, with reference to the accompanying drawings.FIG. 1depicts an overall configuration of the network camera system. The network camera system is configured of a camera apparatus1, which is either a camera with a wide-angle imaging assembly or an omnidirectional imaging camera, a recording apparatus2, and a terminal device3, which are connected via a network4. While only one camera apparatus is depicted inFIG. 1, it would be permissible to connect a plurality of camera apparatuses instead.

The camera apparatus1comprises a wide-angle imaging unit11, a change detection unit12, and a network interface13.

The wide-angle imaging unit11uses such as a wide-angle imaging assembly and a rotating mirror to capture an image over a wide-angle area.

The change detection unit12is configured, at a minimum, of any of a person sensor, a light sensor, an audio sensor, a temperature sensor, and a video analysis unit that analyzes a wide-angle video that is imaged by the wide-angle imaging unit11and detects such as a human figure, a face, or a color. The change detection unit12detects a change of status in a vicinity of the camera apparatus1, computes a position and a size of a region wherein the change of status occurs (hereinafter “region of change of status” or “change of status region”), and notifies a change recording unit22of the recording apparatus2. While only one change detection unit12is depicted inFIG. 1, it would be permissible to install a plurality of the change detection unit12for a single camera apparatus1instead. If the change detection unit12cannot compute the position or the size of the region of change of status, for example, if the change detection unit12does not include the video analysis unit, it would be permissible to preset the region for each respective change detection unit12and treat the preset region as the region of change of status.

The network interface13is for allowing the camera apparatus1to perform a communication with the recording apparatus2or the terminal device3via the network4.

The recording apparatus2comprises a video recording unit21, a change recording unit22, a video extraction unit23, and a network interface24.

The video recording unit21records the wide-angle image that is imaged with the wide-angle imaging unit11of the camera apparatus1and a time whereat the video was imaged.

The change recording unit22records information on a time when the change of status occurs and the region of change of status, when the change of status is detected by the change detection unit12of the camera apparatus1. When the change of status is detected by the change detection unit12of the camera apparatus1, the change detection unit12computes the position and the size of the region of change of status, and transmits the result to the change recording unit22. Upon receipt of the information, the change recording unit22records the time of the receipt of the information as the time when the change of status occurs, and records the position and the size of the region of change of status.

Upon receipt of a command from an extraction management unit33of the terminal device3, the video extraction unit23extracts a portion of a region from the wide-angle video that is recorded by the video recording unit21and transmits the result to the terminal device3.

The network interface24is for allowing the recording apparatus2to perform a communication with the camera apparatus1or the terminal device3via the network4.

The terminal device3comprises a display unit31, a playback time management unit32, the extraction management unit33, a temporary change storage unit34, and a network interface35.

The display unit31displays the video that is transmitted from the recording apparatus2.

The playback time management unit32manages such as a time of imaging the video that is displayed on the display unit31. In particular, when the video is displayed on the display unit31, the playback time management unit32transmits a time that the user specifies to the video recording unit21of the recording apparatus2in order to request the recording apparatus2to transmit the video of the specified time. Also, the playback time management unit32identifies the time of the imaging of the video that is displayed on the display unit31. The network camera system according to the embodiment switches the video that is displayed to the video of the extracted region of the change of status when the time of the imaging of the video being displayed approaches the time when the change of status occurs. A detailed description thereof will be provided hereinafter. The playback time management unit32stores a time prior to change, which determines how close the time of the imaging of the video should get to the time when the change of status occurs before switching the video. It would be permissible to preset the time prior to change, as well as to allow the user to set or change the time prior to change at will.

The extraction management unit33manages the extraction region of the video that is displayed on the image unit31. In particular, when the video is displayed on the display unit31, the video extraction unit23of the recording apparatus2is commanded to extract the region that the user specifies. The video extraction unit23of the recording apparatus2is commanded to extract the region of the change of status when the time of the imaging of the video being displayed approaches the time when the change of status occurs.

The temporary change storage unit34acquires, and temporarily stores, the change of status information that is stored in the change recording unit22, that is, the time when the change of status occurs and the region of the change of status. The playback time management unit32and the extraction management unit33acquire the change of status information from the temporary change storage unit34. The playback time management unit32notifies a time to the extraction management unit33so as to display the video of the region of the change of status at the time prior to change. Upon receipt of the notification thereof, the extraction management unit33so commands the video extraction unit23of the recording apparatus2.

The network interface35is for allowing the terminal device3to perform a communication with the camera apparatus1or the recording apparatus2via the network4.

Following is a description of a video that is displayed on the display unit31with regard to the network camera system according to the embodiment, with reference toFIGS. 2A and 2B.FIG. 2Adepicts the video region. A wide-angle imaging region51is a total region that can be image captured with the wide-angle imaging unit11, a display region52is a region that the user of the terminal device3commands, and a region of a change of status53is the region of the change of status that is detected by the change detection unit12.

FIG. 2Bdepicts a playback time of the video and a time when the change of status occurs on a time line. A time when the change of status occurs54is a time when the change of status that is detected by the change detection unit12occurs. A usual period55is a period wherein no change of status is detected, and a change period57is a period wherein the change of status is detected. A time prior to change56is a time that determines how close the time of the imaging of the video should get to the time when the change of status occurs before switching the video.

When the video is displayed on the display unit31of the terminal device3, the user specifies, on such as a console unit (not shown), a time whereof a verification is desired, and a desired region within the wide-angle imaging region51pertaining to the time whereof the verification is desired.

When the time and the region are specified, the playback time management unit32transmits the specified time to the video recording unit21, and the extraction management unit33transmits the specified region to the video extraction unit23, respectively. In such a circumstance, the specified region is presumed to be the display region52inFIG. 2A, and the specified time is presumed to be prior to the time prior to change56of the usual period55inFIG. 2B.

When the video recording unit21and the video extraction unit23receive the respective time and region information, the video of the specified time and region is transmitted to the terminal device3. The video of the display region52is extracted from the wide-angle imaging region51and displayed on the display unit31. The video of the extracted display region52is matched with a specified playback speed, such as fast forward or slow, and sent to the display unit31, whereupon it is displayed. In such a circumstance, the time of the imaging of the video being displayed is identified by the playback time management unit32.

The video is transmitted from the recording apparatus2to the terminal device3, and the information of the time when the change of status occurs and the region of the change of status that are recorded in the change recording unit22are transmitted and stored in the temporary change storage unit34. The playback time management unit32thus stores the time prior to change that determines how close the time of the imaging of the video should get to the time when the change of status occurs before switching the video.

When the time of the imaging of the video that is being displayed enters the time prior to change56, the extraction management unit33commands the video extraction unit23to extract the region of the change of status53. Consequently, the video that is displayed on the display unit31is switched from the display region52to the region of the change of status53. The video of the region of the change of status53is displayed in the change period57, which is the period wherein the change of status is detected. The video that is displayed on the display unit31is switched from the display region52to a display region that includes the region of the change of status53. It would be permissible for the display region to be of the same size as the region of the change of status53, or to be of a larger size than the region of the change of status53.

FIG. 3is an example of an item and a description thereof of a change of status information that is recorded in either the change recording unit22or the temporary change storage unit34. Camera ID is a key that specifies the camera apparatus1. If a plurality of the camera apparatus1are connected in the network camera system, the camera ID is used to manage the camera apparatus1.

Sensor ID is a key that specifies the change detection unit12that is installed in the camera apparatus1. If a plurality of the change detection unit12are installed in the camera apparatus1, each sensor ID specifies which change detection unit12detects the change of status.

Time is the time when the change of status occurs and a time when the change of status ends, which is detected by the change detection unit12. For example, the time when the change of status occurs54is depicted with regard toFIG. 2B. Status denotes whether the change of status has occurred or has terminated. In the present example, “1” denotes that the change of status has occurred, and “0” denotes that the change of status has terminated.

Position denotes the position of the change of status. Size denotes the size of the region of the change of status. The position and the size are the information that is computed by the change detection unit12.

Following is a description of a circumstance wherein a plurality of changes of status occurs in a temporally overlapping manner with regard to the network camera system according to the embodiment, with reference toFIGS. 4 and 5.

InFIG. 4, a wide-angle imaging region41is an entire region that is capable of being imaged with the wide-angle imaging unit11. A change of status region42is a region of change of status that is detected by the change detection unit12. Similarly, a change of status region43is a region of a change of status that is detected by the change detection unit12. A display region44is a region that incorporates both the change of status regions42and43that is computed by the extraction management unit33.

As the plurality of changes of status occur in the temporally overlapping manner with regard to the recorded image, when the time of the imaging of the video that is being displayed enters the time prior to change, the video that is displayed on the display unit31is switched from the display region that the user specifies to the display region44that incorporates both the change of status regions42and43. The display region44that incorporates both the change of status regions42and43are computed in the present example. The extraction management unit33is capable of computing an optimal display region even when more than one change of status region is present. The following is a description of the computation process.

FIG. 5is a flowchart describing the process of computing the display region that incorporates the plurality of change of status regions. The process is an example of the process of computing the display region when the plurality of changes of status occur in the temporally overlapping manner.

In step S51, the extraction management unit33computes the display region that incorporates all of the change of status regions, when the plurality of change of status regions are present that are to be displayed at a given time.

In step S52, the extraction management unit33computes a ratio of an area of the display region that incorporates all of the change of status regions and an area of the change of status regions that are incorporated within the display region.

In step S53, the extraction management unit33determines whether or not the ratio of the areas of the display region and the change of status region that was derived in step S52is within a stipulated range. If the ratio of the areas is within the stipulated range, the extraction management unit33extracts and displays the display region that incorporates all of the change of status regions. If the ratio of the areas is not within the stipulated range, the process proceeds to step S54, wherein the extraction management unit33increments the display region by one.

In step S55, the extraction management unit33computes all combinations of the plurality of change of status regions and the plurality of display regions.

In step S56, the extraction management unit33computes an area ratio of the display region and the change of status region for each respective combination that is computed in step S55, selects the combination with the ratio that is closest to 1, and returns to step S53.

In step S53, the extraction management unit33determines whether or not the ratio of the areas of the display region and the change of status region in the combination that was selected in step S56is within the stipulated range. If the ratio of the areas is within the stipulated range, the extraction management unit33extracts and displays the display region that incorporates all of the change of status regions on the display unit31. If the ratio of the areas is not within the stipulated range, the process proceeds to step S54, wherein the extraction management unit33increments the display region by one.

As a result, a set of combinations corresponding to display regions is computed such that all of the change of status regions belong to any one of the combinations respectively, each of the display regions has the ratio of the areas within the stipulated range, and the number of display regions is small. Then, the display regions are extracted.

When the extraction management unit33detects, from the information from the temporary change storage unit34, that the change of status regions increases, decreases, moves, enlarges, or reduces, the above process is performed.

FIG. 6depicts an example of the process of computing the area ratio that is performed in the flowchart inFIG. 5.

The ratio of the area of the display region44and the area that is occupied with both the change of status region42and43that is incorporated in the display region44is computed, and if the ratio of the areas is within the stipulated range, the display region44is extracted and displayed. If the ratio of the areas is not within the stipulated range, the display region is increased and the combination that is within the stipulated range is computed.

FIGS. 7A and 7Bdepict another example of the process of computing the area ratio that is performed in the flowchart inFIG. 5. The display region44is depicted inFIG. 7Aincorporates the change of status region42, the change of status region43, and a change of status region45. In the present circumstance, a priority is assigned to the change of status depending on the location of the installation of the camera apparatus1, the type of the change detection unit12, and the combination thereof. InFIG. 7A, it is presumed that the change of status region42is assigned a priority of 1, the change of status region43is assigned a priority of 2, and the change of status region45is assigned a priority of 3, with 1 being the highest priority, followed in order by 2 and 3. When computing the area of the change of status region, a weight is assigned in order of priority. For example, it is presumed that the priority of 1 receives a weight of 1, the priority of 2 receives a weight of 0.5, and the priority of 3 receives a weight of 0.3. A method of computing the area of the change of status region is to compute, in descending order of priority, an area of a region that is the change of status region and does not overlap with a region with a higher priority, and a product of the weight values, and to treat a sum thereof as the area of the change of status region. The area ratio of the display region44and the sum of the change of status region is computed. If, as a result thereof, the ratio of the areas is within the stipulated range, the display region44is extracted and displayed. If the ratio of the areas is not within the stipulated range, the display region is increased and the combination that is within the stipulated range is computed. If the ratio of the areas is within the stipulated range, the display region44that is depicted inFIG. 7Awill be displayed. If, on the other hand, the ratio of the areas is not within the stipulated range, then, as depicted inFIG. 7B, for example, the display region is incremented by one, the change of status region42, with the high priority, will be displayed in a display region44-1, and the change of status region43and the change of status region45, with the lower priority, will be displayed together in a display region44-2.

Whereas the number of display regions is increased from one to two in the example inFIG. 7B, the change of status region increases versus a given display region, simplifying a verification thereof by the user.

Setting the weight according to the priority thus allows changing a setting as usage, such as computing the combination that makes a larger display the change of status region with the high priority versus the display region.

Only a vicinity before or after the time when the change of status occurs54is described according to the embodiment; refer toFIG. 2B. Following is a description of a vicinity before or after a time when the change of status terminates58, with reference toFIG. 8. The time when the change of status terminates58is a time when the change of status that is detected by the change detection unit12terminates. A time after change59is a time after the termination of the change of status wherein the change of status region continues to be displayed.

While it would be permissible to display a specified region that is displayed prior to the time prior to change56, simultaneously with the time when the change of status terminates58, the change of status region continues to be displayed for a given interval, that is, the time after change59, after the time when the change of status terminates58, according to the embodiment. InFIG. 8, the time wherein the change of status region, or the display region that incorporates the change of status region, such as is described inFIG. 4, is displayed, is the time prior to change56, the change period57, and the time after change59. Once the time after change59has elapsed, the specified region that was displayed prior to the time prior to change56is displayed.

A video display state is described in the present circumstance wherein another change of status occurs in a different region after a given change of status terminates, with regard to the recorded video. The description thus far is of an example wherein the specified region that was displayed prior to the time prior to change56is displayed after the time wherein the change of status region, or the display region that incorporates the change of status region, such as is described inFIG. 4, is displayed, has elapsed. It would be permissible to allow a video display state other than the video display state thus described, wherein the change of status region, or the display region that incorporates the change of status region, such as is described inFIG. 4, is displayed smoothly, in sequence, when another change of status occurs in a different region after a given change of status terminates. Following is a description of the video display state thereof, with reference toFIGS. 9Aand9B, andFIGS. 10A and 10B.

Following is a description of an example of a video display state, with reference toFIGS. 9A and 9B.FIGS. 9A and 9Bdepict an example of a video display state wherein the change of status region, or the display region that incorporates the change of status region, such as is described inFIG. 4, is displayed smoothly, in sequence, when the video recording is displayed in a playback mode.FIG. 9Adepicts a region of the video, andFIG. 9Bdepicts a display period thereof in a time line.

InFIG. 9A, a wide-angle imaging region81is a region of all of the images that can be imaged with the wide-angle imaging unit11.

A display region A82is the change of status region, or the display region that incorporates the change of status region, such as is described inFIG. 4, and is a region that is depicted in a display period A85that is depicted inFIG. 9B. As described inFIG. 8, the display period A85is formed from the time prior to change56, the change period57, and the time after change59.

A display region B83is the change of status region, or the display region that incorporates the change of status region, such as is described inFIG. 4, and is displayed in a display period B86that is depicted inFIG. 9B. The display period B86is formed from the time prior to change56, the change period57, and the time after change59, as described inFIG. 8.

A display region C84is the change of status region, or the display region that incorporates the change of status region, such as is described inFIG. 4, and is displayed in a display period C87that is depicted inFIG. 9B. The display period C87is formed from the time prior to change56, the change period57, and the time after change59, as described inFIG. 8.

A transition period88is a time between the display period A85and the display period B86. A transition period89is a time between the display period B86and the display period C87.

The display region A82is extracted and displayed during the display period85. In such a circumstance, a distance between a center of the display region A82and a center of the display region B83, that is, a shortest path therebetween, and a difference between the size and a shape of the regions, is computed. A difference between an end of the display period A85and a start of the display period B86is computed. Then, a transition distance per time unit and a proportion of alteration per time unit, are computed based on the above computed distance and differences of size and shape. During the transition period88, the region is thus extracted, from the display region A82, and displayed that transitions and alters in an elapsed time from a start of the transition period88, in accordance with the per time unit transition distance and proportion of alteration that are derived as per the foregoing. The display region B83is displayed promptly as the display period B86commences as a result.

Similarly, a distance between a center of the display region B83and a center of the display region C84, that is, a shortest path therebetween, and a difference between the size and a shape of the regions, is computed. A difference between an end of the display period B86and a start of the display period C87is computed. Then, a transition distance per time unit and a proportion of alteration per time unit, are computed based on the above computed distance and differences of size and shape. During the transition period89, the region is thus extracted, from the display region B83, and displayed that transitions and alters in an elapsed time from a start of the transition period89, in accordance with the per time unit transition distance and proportion of alteration that are derived as per the foregoing. The display region C84is displayed promptly as the display period C87commences as a result.

The following is a description of an example of a video display state, with reference toFIGS. 10A and 10B.FIGS. 10A and 10Bdepict an example of a method of displaying smoothly, in sequence, the change of status region, or the display region that incorporates the change of status region, such as is described inFIG. 4, when the video recording is displayed in a playback mode.FIG. 10Adepicts the display region of the video, andFIG. 11Bdepicts the display period thereof in a time line.

A transition path8A is a transition path of a region that is computed as a center of the display region B83. The path between the display region A82and the display region B83is derived by computing a polynomial curve that interpolates a center of each of a plurality of display regions that includes, at a minimum, the display region A82and the display region B83. The curve thus derived is the path that joins the centers of the display region A82and the display region B83.

Similarly, a path between the display region B83and the display region C84is derived by computing a polynomial curve that interpolates a center of each of a plurality of display regions that includes, at a minimum, the display region B83and the display region C84. The curve thus derived is the path that joins the centers of the display region B83and the display region C84.

In the figure, the display region A82is extracted and displayed during the display period A85. In such a circumstance, a path distance between the center of the display region A82and the center of the display region B83, and a difference between the size and a shape of the regions, are computed. A difference between an end of the display period A85and a start of the display period B86is computed. Then, a transition distance of the region per time unit and a proportion of alteration per time unit, are computed based on the above computation results. During the transition period88, the region is thus extracted, from the display region A82, and displayed that transitions along a transition path A, and alters in accordance with the per time unit transition distance and proportion of alteration that are derived as per the foregoing, in an elapsed time from a start of the transition period88. The display region B83is displayed promptly as the display period B86commences as a result.

Similarly, a path distance between the center of the display region B83and the center of the display region C84, and a difference between the size and a shape of the regions, are computed. A difference between an end of the display period B86and a start of the display period C87is computed. Then, a transition distance of the region per time unit and a proportion of alteration per time unit, are computed based on the above computation results. During the transition period89, the region is thus extracted, from the display region B83, and displayed that transitions along the transition path A, and alters in accordance with the per time unit transition distance and proportion of alteration that are derived as per the foregoing, in an elapsed time from a start of the transition period89. The display region C84is displayed promptly as the display period C87commences as a result.

Second Embodiment

Following is a description of a network camera system according to a second embodiment of the present invention, with reference to the accompanying drawings.FIG. 11depicts an overall configuration of a network camera system. Whereas the terminal device3comprised the playback time management unit32and the extraction management unit33according to the first embodiment, the recording apparatus2comprises a playback time management unit25and an extraction management unit26according to the second embodiment. A configuration element according to the second embodiment that is shared according to the first embodiment is described with an identical reference numeral attached thereto.

The playback time management unit25manages such as a time of imaging the video that is displayed on the display unit31. In particular, when the video is displayed on the display unit31, a time that the user specifies is transmitted to the video recording unit21to transmit the video of the specified time. The playback time management unit25identifies time of the imaging of the video that is displayed on the display unit31. As per the first embodiment, the video that is displayed is switched to the video of the extracted region of the change of status when the time of the imaging of the video being displayed approaches the time when the change of status occurs.

The extraction management unit26manages the extraction region of the video that is displayed on the image unit31. In particular, when the video is displayed on the display unit31, the video extraction unit23is commanded to transmit the region of the video that the user specifies. As per the first embodiment, the video extraction unit23of the recording apparatus2is commanded to extract the region of the change of status when the time of the imaging of the video being displayed approaches the time when the change of status occurs.

The video that is displayed is switched to the video of the region of the change of status when the time of the imaging of the video being displayed approaches the time when the change of status occurs, according to the respective embodiments. It is thus possible to verify the video of the region wherein the change of status occurs, before the change of status occurs.

The configuration of the network camera system according to the embodiment is not limited thereto. The state of the configuration may be altered as appropriate. For example, it would be permissible to combine the camera apparatus1and the recording apparatus2so as to function in a unitary fashion. It would be permissible to combine each unit that comprises each apparatus so as to function in a unitary fashion. For example, the temporary change storage unit34according to the first embodiment is combined with the change recording unit22according to the second embodiment. Such as combining the extraction management unit33and the video extraction unit23so as to function in a unitary fashion would also be permissible.

It would be permissible to employ a storage medium that records a program code of a software that implements the function of the embodiment as the objective of the present invention. In such a circumstance, the objective of the present invention would be achieved by supplying the storage medium to a system or an apparatus, and a computer, or a CPU or an MPU, of the system or the apparatus loading and executing the program code that is stored on the recording medium.

In such a circumstance, the program code itself that is loaded from the storage medium implements the function of the embodiment, and the program code itself and the storage medium whereupon the program code is stored configure the present invention.

As the storage medium for supplying the program code, for example, it would be possible to use such as a floppy disk, a hard drive, an optical disk, a magneto-optical (MO) disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, or a ROM.

It is to be understood that a circumstance is incorporated wherein an operating system or other software running on the computer performs the actual processing, in whole or in part, in accordance with a command of the program code.

It would also be permissible for the program code that is loaded from the storage medium to be written to a memory that is comprised in an expansion board that is installed in the computer, or an expansion unit that is connected to the computer. In such a circumstance, it would be permissible for the CPU or other hardware that is comprised in the expansion board or the expansion unit to perform the actual processing, in whole or in part, in accordance with the command of the program code.

This application claims the benefit of Japanese Patent Application No. 2006-328701, filed Dec. 5, 2006, which is hereby incorporated by reference herein in its entirety.