Computer-readable storage medium having stored thereon display control program, display control system, display control apparatus, and display control method

Based on an output signal outputted from an input device, a plurality of selection objects having at least a part thereof displayed on a display area of a display device are moved relative to the display area. Among the moved plurality of selection objects, when an end-located selection object reaches a predetermined position of the display area, at least one of the plurality of selection objects displayed on the display area are transformed and displayed.

CROSS REFERENCE TO RELATED APPLICATION

The disclosure of Japanese Patent Application No. 2010-205880, filed on Sep. 14, 2010, is incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a display control process conducted when displaying display-contents such as a selection object that is to be selected by a user and a content that is to be browsed by a user, and more specifically relates to a process conducted when touch-scrolling the selection object and content.

2. Description of the Background Art

An information processing terminal for browsing contents that do not fit within one screen is conventionally known. For example, in a state where one part of a content having a size larger than a screen is displayed on the screen, a mobile phone disclosed in Japanese Laid-Open Patent Publication No. 2000-66801 enables moving the content by an operation on a numerical keypad of the mobile phone. Additionally, this mobile phone displays information indicating a position of the currently displayed content with respect to all the contents in an area outside the display area of the content. For example, a ratio of an amount of contents that have been already displayed at present to the total amount of display contents is represented as a percentage. Therefore, when the display has moved to an end of the content, the user can understand that the display has moved to an end of the content by seeing information on a percentage display.

With the mobile phone described in the Japanese Laid-Open Patent Publication No. 2000-66801, it is necessary to estimate where a content has been moved by using information displayed at an area outside the display area of the content. However, the user will be paying attention to the content when browsing the content. Therefore, in order to see the information at an area outside the display area of the content, the user will take his or her sight off the content for a moment to confirm the information at an area outside the display area of the content. As a result, if the user is performing an operation to move the content while paying attention to the content, even after reaching an end of the content, the user will try to further move the content, thereby generating a futile operation. In other words, the user will conduct a futile operation by trying to further move the content even after reaching an end of the content, and then, shift his or her sight to the information displayed outside the content area to confirm the information and recognize they have reached an end of the content. Therefore, it has been difficult to intuitively understand reaching an end of the content.

SUMMARY OF THE INVENTION

Therefore, an object of the present invention is to provide a computer-readable storage medium having stored thereon a display control program which can improve usability for a user by allowing the user to intuitively understand reaching an end of a display object such as a content and the like.

In order to achieve the above described object, the present invention has adopted the following configurations.

A first aspect is a computer-readable storage medium having stored thereon a display control program executed by a computer of a display control apparatus which displays, on a display device, a selection object selected in accordance with an operation by a user; and the display control program causes the computer to operate as first movement control means, transformation means, and display control means. The first movement control means moves, relative to a display area of the display device, a plurality of selection objects having at least a part thereof displayed on the display area, based on an output signal outputted from an input device. The transformation means transforms at least one of the plurality of selection objects displayed on the display area, when, among the plurality of selection objects moved by the first movement control means, an end-located selection object reaches a predetermined position of the display area. The display control means displays, on the display area, at least a part of the plurality of selection objects so as to include, in the display area, the at least one of the plurality of selection objects transformed by the transformation means.

The first aspect allows the user to intuitively understand that the plurality of selection objects have been moved to an end, without the need of narrowing the area in order to display the plurality of selection objects; thereby enabling further enhancement of usability for the user.

In a second aspect based on the first aspect, the transformation means transforms the at least one of the plurality of selection objects, based on an output signal outputted from the input device.

The second aspect allows the user to further easily understand that the plurality of selection objects have been moved to an end, since one of the plurality of selection objects is transformed in accordance with an operation performed by the user.

In a third aspect based on the first aspect, when the input device stops outputting an output signal, the display control program further causes the computer to operate as restoration means for restoring the at least one of the plurality of selection objects transformed by the transformation means to a state before the transforming.

With the third aspect, as soon as an operation for moving the plurality of selection objects stops, the at least one of the plurality of selection objects that are transformed are restored to original shapes thereof, allowing the user to see the contents; thereby the usability can be further enhanced.

In a fourth aspect based on the first aspect, the transformation means transforms the at least one of the plurality of selection objects, after the selection objects moved by the first movement control means stop.

The fourth aspect allows the user to intuitively understand that the plurality of selection objects cannot be moved further.

In a fifth aspect based on the first aspect, the transformation means transforms the at least one of the plurality of selection objects by elongating the at least one of the plurality of selection objects in a change direction determined based on an output signal outputted from the input device.

In a sixth aspect base on the fifth aspect, when the input device stops outputting an output signal, the display control program further causes the computer to operate as restoration means for restoring, to a state before the transforming, the at least one of the plurality of selection objects, by shrinking them in a direction opposite to the direction in which they are elongated by the transformation means.

The fifth or sixth aspect allows the user to recognize that the selection objects are elongated in accordance with an operation of moving a pointed position, and transformed in accordance with the operation by the user. Furthermore, since the selection objects are restored to their original shapes when the pointing operation is stopped, the user can understand that the plurality of selection objects have moved to an end.

In a seventh aspect based on the fifth aspect, the display control program further causes the computer to operate as second movement control means for moving, among the plurality of selection objects, selection objects other than the selection objects transformed by the transformation means, such that said selection objects do not overlap the selection objects transformed by the transformation means.

The seventh aspect allows the user to intuitively understand that the plurality of selection objects have been moved to an end.

In an eighth aspect based on any one of the first to seventh aspects, when the end-located selection object reaches a predetermined position, the transformation means transforms a selection object displayed on a position that is on a screen of the display device and that is determined based on an output signal outputted from the input device.

With the eighth aspect, transforming can be conducted only on an content element displayed at a touch position where the user can easily pay attention to when using, for example, a touch panel; and the user can intuitively understand that the plurality of selection objects have been moved to an end.

A ninth aspect is a display control system which displays, on a display device, a selection object selected in accordance with an operation by a user; and the display control system includes first movement control means, transformation means, and display control means. The first movement control means moves, relative to a display area of the display device, a plurality of selection objects having at least a part thereof displayed on the display area, based on an output signal outputted from an input device. The transformation means transforms at least one of the plurality of selection objects displayed on the display area, when, among the plurality of selection objects moved by the first movement control means, an end-located selection object reaches a predetermined position of the display area. The display control means displays, on the display area, at least a part of the plurality of selection objects so as to include, in the display area, the at least one of the plurality of selection objects transformed by the transformation means.

A tenth aspect is a display control apparatus which displays, on a display device, a selection object selected in accordance with an operation by a user; and the display control apparatus includes first movement control means, transformation means, and display control means. The first movement control means moves, relative to a display area of the display device, a plurality of selection objects having at least a part thereof displayed on the display area, based on an output signal outputted from an input device. The transformation means transforms at least one of the plurality of selection objects displayed on the display area, when, among the plurality of selection objects moved by the first movement control means, an end-located selection object reaches a predetermined position of the display area. The display control means displays, on the display area, at least a part of the plurality of selection objects so as to include, in the display area, the at least one of the plurality of selection objects transformed by the transformation means.

An eleventh aspect is a display control method for displaying, on a display device, a selection object selected in accordance with an operation by a user; and the display control method includes a first movement control step, a transformation step, and a display control step. The first movement control step is a step of moving, relative to a display area of the display device, a plurality of selection objects having at least a part thereof displayed on the display area, based on an output signal outputted from an input device. The transformation step is a step of transforming at least one of the plurality of selection objects displayed on the display area, when, among the plurality of selection objects moved at the first movement control step, an end-located selection object reaches a predetermined position of the display area. The display control step is a step of displaying, on the display area, at least a part of the plurality of selection objects so as to include, in the display area, the at least one of the plurality of selection objects transformed at the transformation step.

A twelfth aspect is a computer-readable storage medium having stored thereon a display control program executed by a computer of a display control apparatus which displays, on a display device, a content to be browsed by a user; and the display control program causes the computer to operate as first movement control means, transformation means, and display control means. The first movement control means moves, relative to a display area of the display device, a content having at least a part thereof displayed on the display area, based on an output signal outputted from an input device. The transformation means transforms one part of the content displayed on the display area, when an end of the contents, which is moved by the first movement control means, reaches a predetermined position of the display area. The display control means displays, on the display area, the content so as to include, in the display area, the one part of the content transformed by the transformation means.

The ninth to twelfth aspects allows obtaining advantageous effects similar to that of the first aspect.

In a thirteenth aspect based on the twelfth aspect, the content includes a plurality of content elements arranged at a predetermined interval. The first movement control means moves, relative to the display area, the content by integrally moving the plurality of content elements, based on an output signal outputted from the input device. The transformation means transforms the content by changing an arrangement interval of at least two content elements among the plurality of content elements.

With the thirteenth aspect, for example, when scrolling a menu screen having a plurality of contents displayed as icon, the user can intuitively recognize that the scrolling has reached the very end.

A fourteenth aspect is a computer-readable storage medium having stored thereon a display control program executed by a computer of a display control apparatus which displays, on a display device, a content to be browsed by a user; and the display control program causes the computer to operate as first movement control means, transformation means, and display control means. The first movement control means moves, relative to a display area of the display device, a plurality of contents having at least a part thereof displayed on the display area, based on an output signal outputted from an input device. The transformation means transforms at least one of the plurality of contents displayed on the display area, when, among the plurality of contents moved by the first movement control means, an end-located content reaches a predetermined position of the display area. The display control means displays, on the display area, at least a part of the plurality of contents so as to include, in the display area, the at least one of the plurality of contents transformed by the transformation means.

The fourteenth aspect allows obtaining advantageous effects similar to that of the first aspect.

The present invention allows the user to intuitively understand moving to an end of display contents, thereby enabling improvement of usability for the user.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Note that the present invention is not limited to this embodiment.

FIG. 1is an exterior view of a game apparatus1for executing a menu processing program of the present invention. Here, a hand-held game apparatus is shown as one example the game apparatus1. InFIG. 1, the game apparatus1is a foldable hand-held game apparatus in an opened state. The game apparatus1is configured to have such a size as to be held by a user with one hand or both hands in the opened state.

The game apparatus1includes a lower housing11and an upper housing21. The lower housing11and the upper housing21are connected to each other so as to be capable of being opened or closed (foldable). In the example ofFIG. 1, the lower housing11and the upper housing21are each formed in a plate-like shape of a horizontally long rectangle, and rotatably connected to each other at long side portions thereof. Normally, the user uses the game apparatus1in the opened state. When not using the game apparatus1, the user keeps the game apparatus1in a closed state. In the example shown inFIG. 1, in addition to the closed state and the opened state, the game apparatus1is capable of maintaining an angle between the lower housing11and the upper housing21at any angle ranging between the closed state and the opened state by frictional force generated at a connection portion and the like. In other words, the upper housing21can be stationary at any angle with respect to the lower housing11.

In the lower housing11, a lower LCD (Liquid Crystal Display)12is provided. The lower LCD12has a horizontally long shape, and is located such that a long side thereof corresponds to a long side direction of the lower housing11. Note that although an LCD is used as a display device built-in the game apparatus1in the present embodiment, any other display devices such as a display device using an EL (Electro Luminescence) and the like may be used. In addition, the game apparatus1can use a display device of any resolution. Although details will be described below, the lower LCD12is used mainly for displaying an image taken by an inner camera23or an outer camera25in real time.

In the lower housing11, operation buttons14A to14K and a touch panel13are provided as input devices. As shown inFIG. 1, among the operation buttons14A to14K, the direction input button14A, the operation button14B, the operation button14C, the operation button14D, the operation button14E, the power button14F, the start button14G, and the select button14H are provided on an inner main surface of the lower housing11which is located inside when the upper housing21and the lower housing11are folded. The direction input button14A is used, for example, for a selection operation and the like. The operation buttons14B to14E are used, for example, for a determination operation, a cancellation operation, and the like. The power button14F is used for turning on or off the power of the game apparatus1. In the example shown inFIG. 1, the direction input button14A and the power button14F are provided on the inner main surface of the lower housing11and on one of a left side and a right side (on the left side inFIG. 1) of the lower LCD12provided in the vicinity of the center of the inner main surface of the lower housing11. Further, the operation buttons14B to14E, the start button14G, and the select button14H are provided on the inner main surface of the lower housing11and on the other of the left side and the right side (on the right side inFIG. 1) of the lower LCD12. The direction input button14A, the operation buttons14B to14E, the start button14G, and the select button14H are used for performing various operations on the game apparatus1.

Note that the operation buttons14I to14K are omitted inFIG. 1. For example, the L button14I is provided at a left end of an upper surface of the lower housing11, and the R button14J is provided at a right end of the upper surface of the lower housing11. The L button14I and the R button14J are used, for example, for performing a photographing instruction operation (shutter operation) on the game apparatus1. In addition, the volume button14K is provided on a left side surface of the lower housing11. The volume button14K is used for adjusting volume of loudspeakers of the game apparatus1.

The game apparatus1further includes the touch panel13as another input device in addition to the operation buttons14A to14K. The touch panel13is mounted on the lower LCD12so as to cover the screen of the lower LCD12. In the present embodiment, the touch panel13is, for example, a resistive film type touch panel. However, the touch panel13is not limited to the resistive film type, but any press-type touch panel may be used. The touch panel13used in the present embodiment has the same resolution (detection accuracy) as that of the lower LCD12. However, the resolution of the touch panel13and that of the lower LCD12may not necessarily be the same with each other. In a right side surface of the lower housing11, an insertion opening (indicated by a dashed line inFIG. 1) is provided. The insertion opening is capable of accommodating a touch pen27which is used for performing an operation on the touch panel13. Although an input onto the touch panel13is usually performed using the touch pen27, in addition to the touch pen27, a finger of the user can be used for operating the touch panel13.

In the right side surface of the lower housing11, an insertion opening (indicated by a two-dot chain line inFIG. 1) is formed for accommodating a memory card28. Inside the insertion opening, a connector (not shown) is provided for electrically connecting the game apparatus1to the memory card28. The memory card28is, for example, an SD (Secure Digital) memory card, and detachably mounted on the connector. The memory card28is used, for example, for storing an image taken by the game apparatus1, and loading an image generated by another apparatus into the game apparatus1.

Further, in the upper surface of the lower housing11, an insertion opening (indicated by a chain line inFIG. 1) is formed for accommodating a cartridge29. Inside the insertion opening, a connector (not shown) is provided for electrically connecting the game apparatus1to the cartridge29. The cartridge29is a storage medium storing a game program and the like, and detachably mounted in the insertion opening provided in the lower housing11.

Three LEDs15A to15C are mounted on a left side part of the connection portion where the lower housing11and the upper housing21are connected to each other. Three LEDs15A to15C are mounted on a left side part of the connection portion where the lower housing11and the upper housing21are connected to each other. The game apparatus1is capable of performing wireless communication with another apparatus, and the first LED15A is lit up while the power of the game apparatus1is ON. The second LED15B is lit up while the game apparatus1is being charged. The third LED15C is lit up while wireless communication is established. Thus, by the three LEDs15A to15C, a state of ON/OFF of the power of the game apparatus1, a state of charge of the game apparatus1, and a state of communication establishment of the game apparatus1can be notified to the user.

Meanwhile, in the upper housing21, an upper LCD22is provided. The upper LCD22has a horizontally long shape, and is located such that a long side direction thereof corresponds to a long side direction of the upper housing21. In a similar manner to that of the lower LCD12, a display device of another type having any resolution may be used instead of the upper LCD22. A touch panel may be provided so as to cover the upper LCD22. On the upper LCD22, for example, an operation explanation screen for teaching the user roles of the operation buttons14A to14K and the touch panel13is displayed.

In the upper housing21, two cameras (the inner camera23and the outer camera25) are provided. As shown inFIG. 1, the inner camera23is mounted in an inner main surface in the vicinity of the connection portion of the upper housing21. On the other hand, the outer camera25is mounted in a surface opposite to the surface in which the inner camera23is mounted, namely, in an outer main surface of the upper housing21(which is the surface located on the outside of the game apparatus1in the closed state, and the back surface of the upper housing21shown inFIG. 1). InFIG. 1, the outer camera25is indicated by a dotted line. Thus, the inner camera23is capable of taking an image in a direction in which the inner main surface of the upper housing21faces, and the outer camera25is capable of taking an image in a direction opposite to an imaging direction of the inner camera23, namely, in a direction in which the outer main surface of the upper housing21faces. In other words, in the present embodiment, the two cameras23and25are provided such that the imaging directions thereof are opposite to each other. For example, the user can take an image of a view seen from the game apparatus1toward the user with the inner camera23as well as an image of a view seen from the game apparatus1in a direction opposite to the user with the outer camera25.

In the inner main surface in the vicinity of the connection portion, a microphone (a microphone42shown inFIG. 2) is accommodated as a voice input device. In the inner main surface in the vicinity of the connection portion, a microphone hole16is formed to allow the microphone42to detect sound outside the game apparatus1. The accommodating position of the microphone42and the position of the microphone hole16are not necessarily in the connection portion. For example, the microphone42may be accommodated in the lower housing11, and the microphone hole16may be formed in the lower housing11so as to correspond to the accommodating position of the microphone42.

In the outer main surface of the upper housing21, a fourth LED26(indicated by a dashed line inFIG. 1) is mounted. The fourth LED26is lit up at a time when photographing is performed (when the shutter button is pressed) with the outer camera25. Further, the fourth LED26is lit up while a moving picture is being taken by the outer camera25. By the fourth LED26, it is notified to an object person whose image is taken and people around the object person that photographing is performed (being performed) by the game apparatus1.

Sound holes24are formed in the inner main surface of the upper housing21and on left and right sides, respectively, of the upper LCD22provided in the vicinity of the center of the inner main surface of the upper housing21. The loudspeakers are accommodated in the upper housing21and at the back of the sound holes24. The sound holes24are for releasing sound from the speakers to the outside of the game apparatus1therethrough.

As described above, the inner camera23and the outer camera25which are components for taking an image, and the upper LCD22which is display means for displaying, for example, an operation explanation screen at the time of photographing are provided in the upper housing21. On the other hand, the input devices for performing an operation input on the game apparatus1(the touch panel13and the buttons14A to14K), and the lower LCD12which is display means for displaying the game screen are provided in the lower housing11. Accordingly, when using the game apparatus1, the user can hold the lower housing11and perform an input on the input device while seeing a taken image (an image taken by one of the cameras) displayed on the lower LCD12.

Next, an internal configuration of the game apparatus1will be described with reference toFIG. 2.FIG. 2is a block diagram showing one example of the internal configuration of the game apparatus1.

As shown inFIG. 2, the game apparatus1includes electronic components including a CPU31, a main memory32, a memory control circuit33, a stored data memory34, a preset data memory35, a memory card interface (memory card I/F)36and a cartridge I/F44, a wireless communication module37, a local communication module38, a real time clock (RTC)39, a power circuit40, an interface circuit (I/F circuit)41, and the like. These electronic components are mounted on an electronic circuit substrate and accommodated in the lower housing11(or may be accommodated in the upper housing21).

The CPU31is information processing means for executing a predetermined program. Note that a program executed by the CPU31may be stored in advance in a memory within the game apparatus1, may be obtained from the memory card28and/or the cartridge29, or may be obtained from another apparatus by means of communication with said another apparatus. For example, a program may be obtained by means of download via the Internet from a predetermined server, or may be obtained by downloading a predetermined program stored in a stationary game apparatus through communication therewith.

The main memory32, the memory control circuit33, and the preset data memory35are connected to the CPU31. The stored data memory34is connected to the memory control circuit33. The main memory32is storage means used as a work area and a buffer area of the CPU31. In the present embodiment, for example, a PSRAM (Pseudo-SRAM) is used as the main memory32. The stored data memory34is storage means for storing a program executed by the CPU31, data of images taken by the inner camera23and the outer camera25, and the like. The stored data memory34is constructed of a nonvolatile storage medium, for example, a NAND flash memory, in the present embodiment. The memory control circuit33is a circuit for controlling reading of data from the stored data memory34or writing of data to the stored data memory34in accordance with an instruction from the CPU31. The preset data memory35is storage means for storing, in the game apparatus1, data (preset data) of various parameters and the like which are set in advance, and a later described menu processing program and the like. A flash memory connected to the CPU31via an SPI (Serial Peripheral Interface) bus can be used as the preset data memory35.

The memory card I/F36is connected to the CPU31. The memory card I/F36reads data from the memory card28mounted on the connector or writes data to the memory card28in accordance with an instruction from the CPU31. In the present embodiment, data of images taken by the outer camera25is written to the memory card28, and image data stored in the memory card28is read from the memory card28to be stored in the stored data memory34.

The cartridge I/F44is connected to the CPU31. The cartridge I/F44reads out data from the cartridge29mounted to the connector or writes data to the cartridge29in accordance with an instruction from the CPU31.

The wireless communication module37functions to connect to a wireless LAN device, for example, by a method conformed to the standard of IEEE802.11.b/g. The local communication module38functions to wirelessly communicate with a game apparatus of the same type by a predetermined communication method. The wireless communication module37and the local communication module38are connected to the CPU31. The CPU31is capable of receiving data from and transmitting data to another apparatus via the Internet using the wireless communication module37, and capable of receiving data from and transmitting data to another game apparatus of the same type using the local communication module38.

The RTC39and the power circuit40are connected to the CPU31. The RTC39counts a time, and outputs the time to the CPU31. For example, the CPU31is capable of calculating a current time (date) and the like based on the time counted by the RTC39. The power circuit40controls electric power from a power supply (typically, a battery accommodated in the lower housing11) of the game apparatus1to supply the electric power to each electronic component of the game apparatus1.

The game apparatus1includes the microphone42and an amplifier43. The microphone42and the amplifier43are connected to the I/F circuit41. The microphone42detects voice produced by the user toward the game apparatus1, and outputs a sound signal indicating the voice to the I/F circuit41. The amplifier43amplifies the sound signal from the I/F circuit41, and causes the speakers (not shown) to output the sound signal. The I/F circuit41is connected to the CPU31.

The touch panel13is connected to the I/F circuit41. The I/F circuit41includes a sound control circuit for controlling the microphone42and the amplifier43(the speakers), and a touch panel control circuit for controlling the touch panel13. The sound control circuit performs A/D conversion or D/A conversion of the sound signal, and converts the sound signal into sound data in a predetermined format. The touch panel control circuit generates touch position data in a predetermined format based on a signal from the touch panel13, and outputs the touch position data to the CPU31. For example, the touch position data is data indicating coordinates of a position at which an input is performed on an input surface of the touch panel13. The touch panel control circuit reads a signal from the touch panel13and generates touch position data every predetermined period of time. The CPU31is capable of recognizing a position at which an input is performed on the touch panel13by obtaining the touch position data.

An operation button14includes the above operation buttons14A to14K, and is connected to the CPU31. The operation button14outputs operation data indicating an input state of each of the buttons14A to14K (whether or not each button is pressed) to the CPU31. The CPU31obtains the operation data from the operation button14, and performs processing in accordance with an input performed onto the operation button14.

The inner camera23and the outer camera25are connected to the CPU31. Each of the inner camera23and the outer camera25takes an image in accordance with an instruction from the CPU31, and outputs data of the taken image to the CPU31. In the present embodiment, the CPU31gives an imaging instruction to the inner camera23or the outer camera25, and the camera which has received the imaging instruction takes an image and transmits image data to the CPU31.

The lower LCD12and the upper LCD22are connected to the CPU31. Each of the lower LCD12and the upper LCD22displays an image thereon in accordance with an instruction from the CPU31.

Next, a general outline of a process envisioned by the present embodiment will be described. The process of the present embodiment envisions a situation in which a scroll object such as a content and the like having a size that cannot be displayed in a single screen is browsed while being scrolled. Here, the scroll object is, for example, an electronic book content for an electronic book viewer, an electronic document for an electronic document viewer and the like, and a browse object (contents such as an HTML document and a Web page, including a combination of documents and images) for various browsers such as an internet browser (HTML browser). Also included as the scroll object referred here are those including a plurality of objects which are to be selected by the user and which are viewable as a list and which are browsed by using a scroll operation, and examples of those include thumbnails of images on an image viewer, a screen displaying a possession item listing in a game process, a screen displaying a plurality of buttons, and the like. Also categorized as the scroll object is a content of a menu in a menu screen of the game apparatus1(a group of contents including a plurality of contents shown as content icons101described later), and the content of the menu is provided as an example for the specific process of the present embodiment in the following description. Hereinafter, this scroll object will be referred to simply as a content.

When browsing total contents that cannot be displayed all on a single screen as described above, the user can browse all the contents by performing an operation of scrolling the contents (hereinafter, referred to as a scroll operation).

One example of the scroll operation as described above is a so-called drag operation. For example, when one part of the contents is displayed on a screen with a touch panel (the lower LCD12in the present embodiment), by performing touch-on to the touch panel13by using the touch pen27and preforming a slide movement to a predetermined direction, for example, from in the left to right direction by using the touch pen27, the displayed contents can be scrolled to the right direction. As a result, a portion of the contents desired for viewing can be moved within a display screen (display area). Envisioned here is a case where an end of the contents of the browse object has been reached (a case where an end of the contents is displayed in the screen) by repeatedly conducting the scroll operation by the drag operation. In this case, since an end of the contents has been reached, further scroll operation will be a futile operation. In such a case, the present embodiment will notify the user in an intuitive manner about reaching an end of the contents by performing a representation process in coordination with the scroll operation. In the following, such representation process to notify reaching of an end of the contents will be referred to as “scroll limit representation”.

FIG. 3is one example of a screen of the game apparatus1envisioned by the present embodiment. Used as an example in the present embodiment is not an operation mode in which a predetermined game starts up as soon as the power is turned on, but an operation mode in which a menu screen is displayed first.FIG. 3shows the menu screen displayed when the game apparatus1has been started up. The menu screen shown inFIG. 3is displayed on a content area102on the lower LCD12. A plurality of content icons101ato101d(hereinafter, may be referred to by a generic name “content icon”) are arranged side by side in a line and displayed on the content area102. The content icons respectively correspond to predetermined applications (for example, a camera application, an online shopping application, a game application, an application for configuring the game apparatus, and the like). By performing a tap operation on each of the icons, the user can start up an application that corresponds to a tapped icon. Note that, a cursor is displayed on either one of the display content icons, and, in this state, an application corresponding to the content icon on which the cursor is displayed may be started up by hold down, for example the button14B. Here, the number of content icons is more than that capable of being displayed all on a single screen, and the content icons are arranged side by side in a line. The content icon101ais an icon that is at the leftmost end of this group of content icons. Furthermore, scrolling is possible by performing the drag operation as described above on the content area102in the horizontal direction of the content area102. Thus, the respective content icons101can be scrolled as a group (as a group of contents). In the following, such scrolling may be termed simply as “scrolling the content area102”.

One specific example is a case where, as shown inFIG. 4, touch-on is performed on the content icon101dand a drag operation is performed toward the right direction on the screen displaying content icons101cto101f. This will result in a state where the content area102is scrolled to display content icons101bto101eon the screen as shown inFIG. 5. Next, a touch-off is performed once, and then a touch-on is performed on the content icon101bto perform a drag operation toward the right direction again. As shown inFIG. 6, this will result in a state where the content icon101acorresponding to the leftmost end of the contents is fully included within the screen (proximity of the left end of the screen). Thus, this is in a state of reaching the end of the contents as a result of the scroll operation.

It should be noted that, in order to easily understand the descriptions, provided as an example in this figure is a case where the content icon101dis touched-on; however, the above described scrolling is also possible when a portion in the content area102other than the content icons101is touched-on to perform the drag operation.

Here, in a state as shown inFIG. 6, the user moves the touch pen27further toward the right direction without performing a touch-off. Thus, an operation of further scrolling the contents is performed even though the left end of the contents has been reached. If such an operation is performed, in the present embodiment, as shown inFIG. 7, a touched content icon101is elongated in the horizontal direction (X axis direction) and displayed (no elongation in the Y axis direction). More specifically, an image is obtained in which the right side of the position where the content icon101bhas been touched-on is elongated in the X axis direction. Furthermore, the distance of elongation depends on the movement distance of the scroll operation (drag operation). Thus, when the scroll operation is performed at a state of reaching an end of the contents, by having the content icon101elongated depending on the scroll operation, the user can intuitively understand that he or she has scrolled to an end of the contents. Then, if the user performs a touch-off in a state as shown inFIG. 7, the elongated content icon101is restored to its original state to obtain a state as shown inFIG. 8. In the present embodiment, such a representation of transforming the content icon101at a state in which an end of the contents is displayed, corresponds to the above described scroll limit representation.

It should be noted that although the menu screen of the game apparatus1is used in the example described above, the process indicated in the present embodiment is also applicable to a content that cannot be displayed on a single screen of an electronic book viewer, an Internet browser, or the like, to a predetermined scroll object that is to be browsed using a scroll operation such as an item, list in a game process, and to others.

Furthermore, at a state where an end of the contents is displayed, when a drag operation is performed on a portion other than the content icons101, a content icon101at a position closest to the touched coordinates may be transformed. Instead, regardless of the distance from the touched coordinates, a content icon at the very end, which is the content icon101aat the leftmost end in the example inFIG. 6, may be transformed.

Furthermore, in the example with the scroll operation described above, only the drag operation has been provided as an example; however, other than this, in the present embodiment, a flick operation is also possible for scrolling the contents (an operation of performing a touch-on, moving a finger or the touch pen so as to lightly swipe the screen, and performing a touch-off; in other words, performing a touch-on and then an operation so as to flick). The result is a scroll operation having inertia in accordance with the strength of the flick operation. When such flick operation is performed, the scrolling will continue for a short time even after the touch-off, due to inertia force that is based on the strength of the flick operation. It should be noted that, the scrolling stops at the moment when an end of the contents is reached during the scrolling due to this inertia force (hereinafter, referred to as inertia scrolling). Furthermore, when the flick operation is performed at a state where an end of the contents is already displayed (refer to the above describedFIG. 6), the transforming of the content icon101as described above is performed based on the inertia force caused by the flick operation. In this case, all the content icons101in the display area may be transformed in a same manner, or an arbitrary content icon, for example, the content icon101at the very end of the contents, may be transformed. As soon as the inertia force becomes zero, a transformed content icon is restored to its original shape. In the following, a combination of such inertia scrolling and transformation controlling of the content icon101based on inertia force is referred to as “inertia representation”.

In the following, details of various data and program used in the present embodiment will be described by usingFIG. 9toFIG. 14.

FIG. 9is an illustrational figure showing a memory map of the main memory32shown inFIG. 2. InFIG. 9, the main memory32includes a program storage area321and a data storage area323. Data in the program storage area321and in the data storage area323are obtained by copying, to the main memory32, data previously stored in the preset data memory35.

The program storage area321stores a menu processing program322and the like executed by the CPU31.

Data such as scroll limit representation data324, inertia representation data325, a scroll limit representation flag326, an inertia representation flag327, operation data328, lastly inputted coordinates data329, second-from-lastly inputted coordinates data330, and the like are stored in the data storage area323.

The scroll limit representation data324is data used in the scroll limit representation that indicates reaching an end of the contents when the end of the contents is displayed on the screen. In the present embodiment, data necessary for transforming the content icon101is stored as the scroll limit representation data324.

The inertia representation data325is data used for a process of the inertia scrolling as described above (hereinafter, referred to as inertia representation).

The scroll limit representation flag326is a flag for showing whether or not the scroll limit representation for indicating an end of the contents when an end of the contents is displayed on the screen is conducted. When the flag is set to be ON, this indicates that the scroll limit representation is being conducted.

The inertia representation flag327is a flag for indicating whether or not the process of inertia scrolling (inertia representation) is being executed. When the flag is set to be ON, this indicates being in the midst of executing the process of inertia scrolling.

The operation data328is data indicating an input state of each of the operation buttons14A to14K and an input state of the touch panel13. Furthermore, when there is an input to the touch panel13, data indicating coordinates of the input is also included in the operation data328.

The lastly inputted coordinates data329is data indicating coordinates of an input to the touch panel in a process in an immediately preceding frame. In the process in an immediately preceding frame, if there is no input to the touch panel13, the data will be empty, and if there is an input to the touch panel13, the coordinates of the input is stored. Therefore, by referring to the data, a change in touch position (input coordinates) during the drag operation and the like can be calculated, and eventually an amount of movement of the touch pen27can be calculated.

The second-from-lastly inputted coordinates data330is data indicating input coordinates acquired immediately before the lastly inputted coordinates data described above; that is, input coordinates detected in a process in a frame preceding the current frame by two frames.

A flow of the menu process executed in the game apparatus1will be described next by usingFIG. 10toFIG. 14.FIG. 10andFIG. 11are flowcharts showing flows of the menu process executed in the game apparatus1. When the power of the game apparatus1is turned on, the CPU31of the game apparatus1performs a start-up program stored in a boot ROM not shown, and each unit of the main memory32and the like is initialized. Then, the menu program stored in the preset data memory35is loaded into the main memory32, and execution of the menu program is started.

First, in step S1, initialization process for data to be used in the following process is executed. Specifically, first, contents (in the present embodiment, the content icons101) is generated and arranged in a virtual space (in the present embodiment, the content area102allocated in the virtual space) (refer toFIG. 12). Then, a virtual camera is arranged at a position where a predetermined area of one part of the contents is displayed, and an area (hereinafter, display area) imaged by the virtual camera is displayed on the screen. In the present embodiment, when the scroll operation as described above is conducted, scrolling of the contents is achieved by conducting a slide movement of the virtual camera (i.e., display area) on the contents in accordance with the type of operation. In the following, an area imaged by the virtual camera is referred to as the display area. Note that, when the virtual camera is fixed and the scroll operation as described above is conducted, the contents may be moved within the virtual space in accordance with the type of operation.

Note that, the method for displaying the content and the method of the scroll process described above are merely examples and the present invention is not limited thereto, and any processing method may be used as long as displaying and scrolling of the contents can be conducted.

Subsequently, the menu process proceeds by having a process loop of steps S2to S27repeated in every single frame.

Next, at step S2, the operation data328is acquired. Then, at step S3, the acquire operation data328is referenced, and whether or not a touch input is performed to the touch panel13is determined. As a result, if it is determined that a touch input is conducted (YES at step S3), a coordinate value of the input is acquired and whether or not a continuous touch input is performed is determined at the next step S4. This is determined from whether or not some data is set in the lastly inputted coordinates data329. As a result of the determination, if it is determined that a continuous touch input is not performed (NO at step S4), this means an operation categorized as the so-called touch-on is conducted. In this case, first, at step S5, it is determined whether or not an inertia representation is being conducted; that is, determined whether or not it is in a state in which the inertia scrolling by the flick operation as described above is still continuing. As a result, if it is determined that the inertia representation is being conducted (YES at step S5), a process of cancelling the inertia representation is executed at step S6. On the other hand, if it is determined that the inertia representation is not being conducted (NO at step S5), the process at step S6is skipped.

Next, at step S7, a process to be conducted upon the touch-on is executed. In this process, a predetermined process in accordance with the input coordinates described above is executed as appropriate. For example, when the content icons101are touched-on, a process for displaying a description of an application corresponding to the content icons101, or the like is executed. Then, the process is advanced to step S14, which is described later.

On the other hand, as a result of the determination at step S4described above, if it is determined that a continuous touch input is conducted (YES at step S4), the possibility is either a state in which an identical position is continuously being touched, or a drag operation (scroll operation) is being conducted. In such case, next, at step S8, whether or not an end of the contents has been reached is determined for the object displayed in the screen. Thus, it is determined whether or not an end of the contents is within a predetermined position of the display area. For example, with regard to the above described example inFIG. 6, it is determined whether or not (the left side of) the content icon101ahas reached a position having a predetermined margin from the left end of the display area. As a result, if it is determined that an end of the contents has not been reached (NO at step S8), the type of operation is distinguished at step S10, and various processes based on the type of operation are performed as appropriate. For example, if the type of operation is a drag operation in a horizontal direction, the content area102(content icon group) is scrolled to the horizontal direction in accordance with an amount of change and change direction of the input coordinates (more precisely, scrolling of the content area102is achieved by moving the display area described above in accordance with the amount of change and change direction). Then, the process is advanced to step S13, which is described later.

Note that, with regard to the method of determining whether or not an end of the contents has been reached, the processing method described above is merely one example and the present invention is not limit thereto, and any processing method may be used as long as reaching at an end of the contents can be distinguished.

On the other hand, as a result of the determination at step S8, if it is determined that an end of the contents is included in the display area (YES at step S8), next, at step S9, the type of operation is distinguished based on the operation data328, and it is determined whether or not a scroll operation exceeding the end of the contents is performed. For example, with regard to the above described example inFIG. 6, it is determined whether a drag operation to the right direction (a drag operation to a direction opposite of the end, a scroll operation so as to further move an end portion in the screen) is conducted. As a result, if a scroll operation exceeding the end of the contents is not performed (NO at step S9), the process at step S10described above is executed. Thus, a process in accordance with the type of operation is conducted as appropriate. For example, if a drag operation to the left direction is performed in a state ofFIG. 6described above, a process of scrolling the contents in accordance with the drag operation is executed. Then, the process is advanced to step S13, which is described later.

On the other hand, as a result of the determination at step S9described above, if it is determined that a scroll operation exceeding the end of the contents is performed (YES at step S9), a scroll limit representation process is executed at step S12.FIG. 13is a flowchart showing details of the scroll limit representation process indicated at step S12described above. InFIG. 13, first, at step S41, it is determined whether or not the scroll limit representation is being executed, by referring to the scroll limit representation flag326. As a result, if it is determined that the scroll limit representation is being conducted (YES at step S1), the process is advanced to step S44, which is described later.

On the other hand, if it is determined that the scroll limit representation is not being conducted (NO at step S41), at the next step S42, a preparation process for executing the scroll limit representation is executed. Thus, a preparation for the process of transforming the content icon101is executed. Specifically, a touch position at which the content icon101is currently touched is distinguished. Next, a vertical thin slice image of the content icon101including the touch position is copied. Then the copied image is stored in the main memory32as one part of the scroll limit representation data324.

Next, at step S43, the scroll limit representation flag is set to be ON.

Next, at step S44, a process for transforming the touched content icon is executed. Specifically, the touched position is distinguished. Then, referring to the scroll limit representation data324, the thin slice image is read-out and inserted at the touched position to generate an image giving an impression that the content icon101has elongated in the horizontal direction. Thus, the content icon101is transformed.

It should be noted that the processing method described above is merely one example and the present invention is not limited thereto, and as long as the content icon101is transformed so as to be elongated, any processing method may be used. Furthermore, the transparency of the content icon101may be changed in accordance with the degree of elongation.

With this, the scroll limit representation process ends.

Returning toFIG. 11, next to the scroll limit representation at step S12, at step S13, the lastly inputted coordinates data329is set. Specifically, first, a content of the lastly inputted coordinates data329is stored in the main memory32as the second-from-lastly inputted coordinates data330. Furthermore, the input coordinates of a touch position included in the operation data acquired at step S2described above is stored in the main memory32as the lastly inputted coordinates data329. Next, at step S14, a display process is conducted. More specifically, an image reflecting the above described process is generated, and a process of displaying the image on the lower LCD12is executed. Then, the process returns to the above described step S2, and the process is repeated.

Described next is the process conducted when it is determined, as a result of the determination at step S3described above, that a touch input is not performed (NO at step S3). In this case, first, at step S15inFIG. 12, it is determined whether or not the current operation state is a touch-off. Specifically, the lastly inputted coordinates data329is referenced, and if some data is stored therein, the current operation state is determined as a touch-off, and if the lastly inputted coordinates data329is empty, the current operation state is determined as not being a touch-off (thus a state of not being touched has been continuing). As a result of the determination, if the current operation state is determined as a touch-off (YES at step S15), next, at step S16, it is determined whether or not the touch-off is one with inertia due to a flick operation as described above. This is determined from whether or not the amount of change of input coordinates, which is indicated from the lastly inputted coordinates data329and the second-from-lastly inputted coordinates data330, is equal to or larger than a predetermined value. If the amount of change is at a certain degree, it is determined that a flick operation as described above is conducted and that the touch-off with inertia is generated.

As a result of the determination at step S16, if it is determined that the touch-off with inertia is performed (YES at step S16), next, at step S22, an inertia touch-off process is executed. This process is a process for conducting the inertia representation as described above.

FIG. 14is a flowchart showing details of the inertia touch-off process indicated at step S22described above. InFIG. 14, first, at step S61, it is determined whether or not the current contents end is within the display area, that is, whether or not it is in a state of reaching an end of the contents. As a result of the determination, if it is determined that an end of the contents has not been reached yet (NO at step S61), at step S62, various parameters for conducting the inertia scrolling as described above are calculated. For example, an amount of scrolling, a velocity of scrolling, a duration of scrolling, and the like are calculated in accordance with the amount of change of input coordinates indicated from the lastly inputted coordinates data329and the second-from-lastly inputted coordinates data330. Then, at step S64which is next, the calculated parameters are stored in the main memory32as the inertia representation data325.

On the other hand, as a result of the determination at step S61, if it is determined that an end of the contents has been reached (YES at step S61), at step S63, various parameters for conducting the scroll limit representation as described above are calculated. For example, inFIG. 3, if only the content icon101aat the very end of the contents is transformed by the inertia force, calculated are various parameters for elongating the content icon101aat the very end of the contents in the horizontal direction in accordance with the amount of change in the input coordinates. Which means, various parameters necessary for conducting the scroll limit representation with inertia force are calculated. Then, the calculated parameters are stored as the inertia representation data325at step S64described above.

Next, at step S65, the inertia representation flag327is set to be ON. At the following step S66, the inertia representation is initiated based on the inertia representation data325. As a result, the above described inertia scrolling will be displayed if an end of the contents has not been reached when the touch-off caused by the flick operation is performed. Furthermore, if the touch-off caused by the flick operation is performed at a state of reaching an end of the contents, the above described scroll limit representation based on inertia force will be displayed, even in a state where the user is not touching the touch panel13. With this, the inertia touch-off process ends.

Returning toFIG. 12, when the process at step S22ends, the process is advanced to step S21, which is described later.

On the other hand, as a result of the determination at step S16described above, if it is determined that the touch-off with inertia is not conducted (i.e., a normal touch-off without the flick operation is performed) (NO at step S16); next, at step S17, it is determined whether or not the scroll limit representation is being conducted by referring to the scroll limit representation flag326. As a result, if it is determined that the scroll limit representation is conducted (YES at step S17), this means that the touch-off is conducted in a state where the content icon101is transformed as shown inFIG. 7. Then, at the next step S18, resetting of the scroll limit representation is conducted. Thus, a process for restoring the transformed content icon101to its original state is executed.

Next, at step S19, the scroll limit representation flag326is set to be OFF.

On the other hand, as a result of the determination at step S17described above, if it is determined that the scroll limit representation is not being conducted (NO at step S17), the processes at steps S18and S19described above are skipped.

Next, at step S20, various processes to be conducted upon touch-off are executed. For example, if a touch-off is conducted in a state where a content icon101has been touched (i.e., if a tap operation is performed on the content icon101), a process and the like for starting up an application corresponding to the content icon101that has been touched is executed. Note that, when any application starts up, the menu process stops for a moment but restarts when the application ends.

Next, at step S21, associated with the touch-off operation, the lastly inputted coordinates data329and the second-from-lastly inputted coordinates data330are cleared. Then, the process is advanced to step S14, which is described above.

Described next is the process conducted when it is determined as not being a touch-off as a result of the determination at step S15described above (NO at step S15). In this case, it can be assumed that a state where the user is not touching the touch panel is continuing. In such case, first, at step S23, the inertia representation flag327is referenced, and it is determined whether or not the inertia representation is being conducted. As a result, if it is determined that the inertia representation is not being conducted (NO at step S23), the process is advanced to step S27, which is described later.

On the other hand, if it is determined that the inertia representation is being conducted (YES at step S23), next, at step S24, the process of the inertia representation based on the inertia representation data325is continued.

Next, at step S25, whether or not an ending condition of the inertia representation is satisfied is determined. For example, depending on whether or not the inertia scrolling has reached an amount indicated by the inertia representation data325, whether or not the inertia representation should be ended is determined. In addition, the ending condition of the inertia representation is determined to be satisfied also when an end the contents has been reached during the inertia scrolling. As a result of the determination of step S25, if it is determined that the ending condition of the inertia representation is not satisfied (NO at step S25), the process is advanced to step S27, which is described later. On the other hand, if it is determined that the ending condition of the inertia representation is satisfied (YES at step S25), at step S26, the inertia representation flag327is set to be OFF.

Next, at step S27, various processes for those other than the inertia representation described above are performed as appropriate. Descriptions of these processes are omitted since they are not directly related to the present embodiment. Then, the process is advanced to step S14described above. This concludes the descriptions of the menu process of the present embodiment.

As described above, in the present embodiment, when an end of the contents is within the display area and when a scroll operation is performed in a situation where further scroll operation is unnecessary, the content icon101(i.e., the content itself) is transformed in accordance with the scroll operation and is displayed. This allows the user to intuitively understand scrolling to an end of the contents, without the need of narrowing the area in which the contents are displayed.

In the embodiment described above, with regard to the transformation of the content icon101when conducting the scroll limit representation, an example is described in which the content icon101is elongated in the horizontal direction but no changes are made in the vertical direction. Instead, the content icon101that is to be transformed may be transformed also in the vertical direction. For example, as shown inFIG. 15, in addition to the elongation in the horizontal direction, the content icon101b, which is a transformation object, may be transformed so as to shrink in the vertical direction.

Otherwise, for example, as shown inFIG. 16, the whole contents (in the present embodiment, the content area102) may be transformed such that the distance between the content icon101aand the content icon101bexpands. In this case, it is preferably if a portion of the contents at the very end (the content icon101ainFIG. 16) is not moved. For example, as shown inFIG. 17, if an operation of scrolling, in the vertical direction, an electronic document in horizontal writing is used as an example; the line at the very end is not moved and the contents (in this case, the electronic document) may be transformed such that the distance between the first line and the second line expands as shown inFIG. 18.

Furthermore, for example, the content icon101may be transformed so as to be divided, and may be displayed, as shown inFIG. 19.

Furthermore, in the embodiment described above, the scrolling stops at the time point when reaching an end of the contents during inertia scrolling. Other than stopping, the scroll limit representation as described above may be conducted in accordance with inertia force remaining when reaching an end of the contents. More specifically, the content icon101(for example, the content icon101positioned at the very end of the contents) may be transformed in accordance with remaining inertia force.

Furthermore, in the embodiment described above, described mainly as an example is an operation on a menu screen of a hand-held game apparatus capable of touch operation. However, the applicable apparatus of the present invention is not limit thereto, and the present invention is also applicable when scrolling contents by conducting the drag operation as described above by using a pointing device on various information processing terminals such as a stationary game apparatus, a personal computer, an electronic book reader, and the like. Other than the touch panel described above, the pointing device may be, for example: a mouse capable of pointing an arbitrary position on a screen, a tablet which is without a display screen and which is for instructing an arbitrary position on an operation surface; and a pointing device that calculates coordinates which are on a display screen and which correspond to a pointed position instructed on a display screen, the coordinates being calculated by using a position of the display screen and a marker within an image taken by pointing a device in a direction of the display screen, the device including imaging means for remotely imaging the display screen, markers arranged in the periphery of the display screen, and the like.

Furthermore, with regard to the applications and the like that can be used, as described above, various applications such as an electronic document viewer, an interne browser, and the like for browsing while scrolling contents that cannot be displayed on a single screen can be used. Alternatively, the present invention is applicable to a general situation where a list of some information, for example, an item list and the like in a game process, is displayed and where it is necessary to perform a scroll operation.

Furthermore, in the embodiment described above, horizontal scrolling is used as an example, however, the scrolling direction is not limit thereto, and the present invention is also applicable to vertical scrolling.

Furthermore, in the embodiment described above, as an example of a device for detecting a position pointed by a player in an operation area when conducting the scroll operation, the touch panel is used; however, a so-called pointing device which allows the player to instruct a position within a predetermined area may be used including examples such as: a mouse capable of pointing an arbitrary position on a screen, a tablet which is without a display screen and which is for instructing an arbitrary position on an operation surface; and a pointing device that calculates coordinates which are on a display screen and which correspond to a pointed position instructed on a display screen, the coordinates being calculated by using a position of the display screen and a marker within an image taken by pointing a device in a direction of the display screen, the device including imaging means for remotely imaging the display screen, markers arranged in the periphery of the display screen, and the like. Furthermore, instead of the pointing device, present invention is also applicable when conducting the scrolling as described above by an operation using a button such as, for example, a cross key, a cursor key, and the like. When such an operation using a button is conducted, for example, when a scroll operation is performed by holding down the left button of a cross key and when the left button is continuously held down after reaching an end of the contents, the scroll limit representation as described above will be conducted.

Furthermore, in the embodiment described above, a case has been described where a series of processes for conducting the scroll limit representation in accordance with the scroll operation are executed on a single apparatus (the game apparatus1). However, in another embodiment, the series of processes may be executed on an information processing system including a plurality of information processing apparatuses. For example, in an information processing system which includes a terminal side apparatus and a server side apparatus that is capable of communicating with the terminal side apparatus via a network, one part of the processes among the series of processes may be executed on the server side apparatus. Further, in an information processing system which includes a terminal side apparatus and a server side apparatus that is capable of communicating with the terminal side apparatus via a network, main processes of the series of processes may be executed on the server side apparatus, and one part of the processes may be executed on the terminal side apparatus. Still further, in the information processing system described above, the system on the server side may be configured with a plurality of information processing apparatuses, and processes to be executed on the server side may be divided to be executed by the plurality of information processing apparatuses.