Patent Description:
In recent years, various kinds of applications with high entertainment value have been developed. Further, technologies which can create various kinds of added values by providing extension functions in cooperation with such applications as described above have also been proposed. For example, PTL <NUM> discloses a technology for synthesizing an image of a user who is playing a game application, onto a game screen, and for distributing the resulting screen.

As described above, in the case where an extension function is provided to an external application, cooperation is important so as not to cause any interference with the original behavior of such an external application and the user's operation of the application.

Prior art includes: <CIT>, <CIT> and <CIT>. Each of these prior art disclosures describes a prior art device.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the appended drawings. Note that, in the present specification and the drawings, elements that have substantially the same function and structure are denoted with the same reference signs, and repeated explanation is omitted.

Note that descriptions will be made in the following order.

First, descriptions will be made regarding an example of the functional configuration of an information processing apparatus <NUM> according to one embodiment of the present disclosure. As described earlier, in recent years, various kinds of applications with high entertainment value have been developed. Examples of such applications as described above include game applications. A user can easily play various game applications by using, for example, a terminal such as a smartphone.

In addition, in recent years, user's enjoyment has not been limited to only playing a game application. Sharing the user's playing status of the game application with others has become popular. For example, the user can transmit, to an acquaintance, a moving image produced by synthesizing an image of a user's face on the recorded screen of playing status of a game application, or can distribute the moving image to an unspecified large number of viewers/listeners via a moving image distribution service or other services. Sharing of such a moving image allows the viewers/listeners to enjoy the playing status of the game application together with the distributer's reaction and the like, and thus enables the experience of gaming to be shared among a plurality of users.

Here, in the case where such a moving image as described above is to be produced, in general, editing work is necessary for synthesizing a user's own image, after the image of the playing status of the game application is recorded and the user's image is photographed simultaneously. However, such editing work requires knowledge regarding moving image editing and the like, in addition to time and labor.

On the other hand, in order to reduce such a burden on the distributor as described above, there is also known a technology for automatically producing a play moving image in which the distributor's own image is synthesized, by cooperating with the game application, as described in PTL <NUM>, for example. By using such a technology, even a distributor having no knowledge regarding moving image editing can easily produce a play moving image of a game application, distribute the resulting image, and do any other related action.

However, in the case where such a technology as described above is used to provide an extension function to an external application, cooperation is important so as not to cause any interference with the original behavior of such an external application and the user's operation of the external application. In addition, it is also desirable that the user is able to operate the external application more intuitively and to flexibly control the extension function according to the situation of the external application.

The technical idea of the present disclosure has been conceived in view of the above-described situation and makes it possible to provide an extension function that permits more intuitive operations without interfering with the behavior of the external application. To this end, the information processing apparatus <NUM> according to the embodiment of the present disclosure includes a controller <NUM> that controls functional extension for an external application. Further, one of the features of the controller <NUM> according to the embodiment of the present disclosure is that an extended menu icon whose display position is adjustable is displayed and superimposed on the display window of the external application, and that the display position of an extended menu is controlled according to the display position of the displayed-superimposed extended menu icon. In addition, one of the features of the controller <NUM> according to the embodiment of the present disclosure is that the controller <NUM> causes an extension function icon associated with the extension function having been selected on the extended menu described above, to be displayed and superimposed on the display window described above, with the display position of the extension function icon being adjustable, and that the controller <NUM> controls the display position of a sub-icon accompanying the displayed-superimposed extension function icon according to the display position of the extension function icon.

Hereinafter, detailed descriptions will be made regarding an example of the functional configuration of the information processing apparatus <NUM>, which has the features described above, according to the present embodiment. The information processing apparatus <NUM> according to the present embodiment may be a smartphone, a tablet, a PC (Personal Computer), or the like capable of executing various kinds of applications.

<FIG> depicts a block diagram illustrating an example of the functional configuration of the information processing apparatus <NUM> according to the present embodiment. As depicted in <FIG>, the information processing apparatus <NUM> according to the present embodiment includes an operation unit <NUM>, a sound input unit <NUM>, an image capturing unit <NUM>, the controller <NUM>, a sound output unit <NUM>, and a display unit <NUM>.

The operation unit <NUM> according to the present embodiment detects various operations by a user, such as an operation of an application. For this function, the operation unit <NUM> according to the present embodiment includes, for example, a touch panel, a button, a keyboard, a mouse, and the like. The operation unit <NUM> according to the present embodiment inputs, to the controller <NUM>, information associated with the detected user's operation.

The sound input unit <NUM> according to the present embodiment collects the sound uttered by the user and the like, on the basis of control by the controller <NUM>. For this function, the sound input unit <NUM> according to the present embodiment includes a microphone and the like.

The image capturing unit <NUM> according to the present embodiment photographs a moving image on the basis of control by the controller <NUM>. The image capturing unit <NUM> may photograph, for example, a face or the like of a user who operates the information processing apparatus <NUM>. For this function, the image capturing unit <NUM> according to the present embodiment includes an imaging element. The smartphone, which is an example of the information processing apparatus <NUM>, includes an inward-facing camera that photographs the user's face and the like and is disposed on the display unit <NUM> side and a main camera that photographs a landscape and the like and is disposed on the back side of the display unit <NUM>. In the present embodiment, photographing by using the inward-facing camera is controlled, as an example.

The controller <NUM> according to the present embodiment controls each of the components included in the information processing apparatus <NUM>. In addition, one of the features of the controller <NUM> according to the present embodiment is to control the extension of the functions of external applications. Details of the functions of the controller <NUM> according to the present embodiment will separately be described later.

The sound output unit <NUM> according to the present embodiment outputs various sounds. The sound output unit <NUM> according to the present embodiment outputs sounds according to the situation of an application on the basis of control by the controller <NUM>, for example. For this function, the sound output unit <NUM> according to the present embodiment includes a loudspeaker and an amplifier.

The display unit <NUM> according to the present embodiment displays various kinds of visual information on the basis of control by the controller <NUM>. The display unit <NUM> according to the present embodiment may display, for example, images and characters associated with an application. For this function, the display unit <NUM> according to the present embodiment includes various kinds of display devices.

Up to this point, the descriptions have been made regarding the example of the functional configuration of the information processing apparatus <NUM> according to the present embodiment. It should be noted that the configuration described above with reference to <FIG> is merely an example, and the functional configuration of the information processing apparatus <NUM> according to the present embodiment is not limited to such an example. The functional configuration of the information processing apparatus <NUM> according to the present embodiment may flexibly be modified according to specifications and operation.

Next, detailed descriptions will be made regarding the functions of the information processing apparatus <NUM> according to the present embodiment. One of the features of the controller <NUM> of the information processing apparatus <NUM> according to the present embodiment is to control extended applications for providing extension functions to various kinds of external applications. Examples of the external applications described above may include a game application. The controller <NUM> according to the present embodiment is capable of providing an extension function such as an image-recording function to an external game application produced by a different company, for example, by causing the above-described extended application to cooperate with the external application.

Note that descriptions will hereinafter be made by using a case, as a major example, where the external application associated with the present embodiment is a game application; however, the external application associated with the present embodiment is not limited to such an example. Examples of the external application associated with the present embodiment may include drawing applications, various kinds of editing applications, and applications for viewing/listening moving images, music, etc..

Further, the external application associated with the present embodiment is not limited to an application produced by a different company, and it may be an application produced in-house. By using the extended application according to the present embodiment, it is possible to easily provide an extension function to an already-existing application no matter who its producer is, without editing the source code or the like.

<FIG> depicts a diagram for illustrating cooperation between the extended application according to the present embodiment and an external application. Both the extended application according to the present embodiment and the external application function by being installed in the information processing apparatus <NUM>.

On the left side of <FIG>, there is depicted a home screen of an OS (Operating System) displayed on the display unit <NUM> of the information processing apparatus <NUM>. Here, in the case where a user selects an icon Ia associated with an extended application, the controller <NUM> starts the extended application and, as depicted in the center of the figure, causes the display unit <NUM> to display a start screen of the extended application.

In the case of one example depicted in <FIG>, on the start screen described above, there are displayed icons Ig and Ih associated with installed external applications that are available for cooperation and icons Ii to Ik associated with not-installed external applications that are recommended to the user. The controller <NUM> is capable of automatically producing a list of applications that includes installed external applications and exemplified applications based on recommendation information or other information. Further, such external applications displayed on the start screen may include another one optionally added by the user.

Here, in the case where the user selects an icon associated with an intended external application, as depicted on the right side of the figure, the controller <NUM> starts the external application corresponding to the selected icon, and causes the display unit <NUM> to display the display window of the intended external application. In <FIG>, one example of the case is depicted in which the user selects the icon Ig associated with a racing game on the start screen described above.

Further, at this time, the controller <NUM> causes an extended menu icon MI to be superimposed and displayed on the display window described above. The extended menu icon MI may be an icon for invoking a menu of extension functions to be provided to the external application. In addition, the user may be allowed to move the extended menu icon MI to any position on the display window by dragging the extended menu icon MI, for example. By appropriately moving the extended menu icon MI according to the situation of display screen of the external application, it is possible to avoid interference with the user's operation of the external application and the display of various kinds of visual information displayed by the external application.

Note that the above description has been made regarding the exemplified case where the user starts the external application to be cooperated with the extended application via the start screen of the extended application. However, for example, the user may be able to directly select the icon associated with the intended external application, on the home screen, so as to start the intended external application in the state of being in cooperation with the extended application.

Next, the display control of the extended menu according to the present embodiment will be described. As described above, the user can invoke an extension function menu by selecting the extended menu icon MI that is superimposed and displayed on the display window of the external application. In such a case, the controller <NUM> according to the present embodiment controls the display position of the extended menu on the basis of the display position of the extended menu icon MI on the display window.

The controller <NUM> according to the present embodiment may control the display position of the extended menu on the basis of both the display position of the extended menu icon MI and the aspect ratio of the display window, for example. <FIG> and <FIG> are diagrams for illustrating the extended menu display based on the display position of the extended menu icon according to the present embodiment.

In general, there are an external application operated with the information processing apparatus <NUM> held vertically, an external application operated with the information processing apparatus <NUM> held horizontally, and an external application operated while the display of the information processing apparatus <NUM> is turned according to the posture of the information processing apparatus <NUM>. For this reason, the controller <NUM> according to the present embodiment is capable of displaying the extended menu at a position which permits easier operation of the menu, by detecting the aspect ratio of the display window of the external application.

For example, in the case of one example depicted in <FIG>, the display unit <NUM> is displaying a display window that is suitable for the operation using the information processing apparatus <NUM> in the state of being held vertically. In this way, in the case where the display window is in a state where its side along the height direction is longer than its side along the width direction, the controller <NUM> may cause an extended menu M to be superimposed and displayed in either an upper region or a lower region of the display window that contains the display position of the extended menu icon MI.

For example, in the case of one example depicted in the upper stage of <FIG>, the extended menu icon MI is located in the upper region of the display window. Here, in the case where the extended menu icon MI is selected, the controller <NUM> may cause the extended menu M to be superimposed and displayed in the upper region of the display window, similarly to the display position of the extended menu icon MI.

On the other hand, in the case of one example depicted in the lower stage of <FIG>, the extended menu icon MI is located in the lower region of the display window. Here, in the case where the extended menu icon MI is selected, the controller <NUM> may cause the extended menu M to be superimposed and displayed in the lower region of the display window, similarly to the display position of the extended menu icon MI.

Further, for example, in the case of one example depicted in <FIG>, the display unit <NUM> is displaying a display window that is suitable for operation using the information processing apparatus <NUM> in the state of being held horizontally. In this way, in the case where the display window is in a state where its side along the width direction is longer than its side along the height direction, the controller <NUM> may cause the extended menu M to be superimposed and displayed in either a left-side region or a right-side region of the display window that contains the display position of the extended menu icon MI.

For example, in the case of one example depicted in the upper stage of <FIG>, the extended menu icon MI is located in the left-side region of the display window. Here, in the case where the extended menu icon MI is selected, the controller <NUM> may cause the extended menu M to be superimposed and displayed in the left-side region of the display window, similarly to the display position of the extended menu icon MI.

On the other hand, in the case of one example depicted in the lower stage of <FIG>, the extended menu icon MI is located in the right-side region of the display window. Here, in the case where the extended menu icon MI is selected, the controller <NUM> may cause the extended menu M to be superimposed and displayed in the right-side region of the display window, similarly to the display position of the extended menu icon MI.

Up to this point, the descriptions have been made regarding the display control of the extended menu M based on the display position of the extended menu icon MI according to the present embodiment. According to the display control as described above, the user having performed the operation of the extended menu icon MI can successively select any extension function in the same region, and thus, the extended menu display featuring easier operation can be realized. In addition, according to such a display control as described above, the extended menu M can be displayed in the same region as the display position of the extended menu icon MI that has been moved by the user to the position where the icon does not obstruct user's operations. This can effectively reduce the possibility that important visual information output by the external application is screened from view by the extended menu M.

Note that, in the example depicted in <FIG> and <FIG>, a case is illustrated in which the functions of setting a game mode, setting focus, searching, taking a screenshot, and recording an image are offered as extension functions.

The function of setting a game mode described above may be an extension function capable of setting, for each external application, a mode such as a mode with priority given to the power saving or a mode with priority given to the performance, for example.

Further, the function of setting focus described above may be an extension function capable of setting various kinds of conditions that can help a user further concentrate on the external application, for example. The user may be able to set functions of releasing a RAM, locking a navigation bar, not displaying notification from other applications such as a message application, and turning-off the function of automatic brightness adjustment of the display unit <NUM>, for example. The details of the game mode setting and focus setting may be stored after the external application has ended, thereby allowing the setting to be reflected automatically upon starting up the next operation.

Further, the function of searching described above may be an extension function capable of performing various kinds of information retrieval on the display window of the external application, without separately starting the browser application by the user. By use of the searching function, the user can play a game while referring to, on the display window, information for strategy, for example.

Further, the function of taking a screenshot described above may be an extension function capable of storing the playing status of the external application as a still image. In addition, the function of recording an image described above may be an extension function capable of storing the playing status of the external application as a moving image. Details of the function of image-recording according to the present embodiment will separately be described later.

Up to this point, the descriptions have been made regarding the example of the extended menu M and the extension function according to the present embodiment. Note that such an extension function as described above is used by the user according to the situation, so that the extension function is not assumed to be usually frequently operated. For this reason, the extended menu icon MI for invoking the extended menu M as described above is preferably displayed so as not to interfere with the playing of the external application as much as possible in the case where the user's operation is not given.

For this reason, the controller <NUM> according to the present embodiment may control the display position and the manner of display of the extended menu icon MI such that the extended menu icon MI becomes less noticeable in the case where the user's operation of the extended menu icon MI is not performed for a predetermined period of time.

<FIG> depicts a diagram for illustrating the display control of the extended menu icon MI on the basis of non-operation time according to the present embodiment. In one example depicted on the left side of <FIG>, the extended menu icon MI is disposed in the lower right corner of the display window. In this way, in the case where the extended menu icon MI in an edge region in the display window has not been used for more than a predetermined period of time, the controller <NUM> may cause the extended menu icon MI to move to a position where at least a part of the extended menu icon MI hides outside the display window as described on the right side of <FIG>.

Further, in addition to the control of the display position described above, the controller <NUM> according to the present embodiment may control the manner of display such that the extended menu icon MI becomes less noticeable. For example, in the case where the extended menu icon MI has not been used for more than a predetermined period of time, the controller <NUM> may control the superimposed display such that the degree of highlighting of the extended menu icon MI decreases. The controller <NUM> may cause the extended menu icon MI to be grayed out or to be made translucent, for example.

According to the control as described above, in the case where no operation of the extension function is made for a long period of time, the extended menu icon MI is automatically moved to a position where the extended menu icon MI is less likely to interfere with the playing of the external application, and is reduced in the degree of highlighting, thereby allowing the user to concentrate on playing the external application.

Note that, in the case where the extended menu icon MI is disposed in a center region of the display window, it is assumed that the user is highly likely to perform an operation of the extension function from now on. For this reason, in the case where the extended menu icon MI is disposed in the center region, the controller <NUM> need not perform both the change of the display position and the control of the manner of display as described above.

Next, a detailed description will be made regarding the image-recording function that is one of the extension functions according to the present embodiment. The user, through use of the extended application according to the present embodiment, can record the image of the playing status of any external application and store it as a moving image. In such a case, the controller <NUM> according to the present embodiment may cause the image photographed by the image capturing unit <NUM>, to be superimposed and displayed on the display window, and may record the superimposed image together with the playing status of the external application.

<FIG> depict diagrams for illustrating the image-recording function according to the present embodiment. In the case where the image-recording function is selected on the extended menu M, the controller <NUM> causes both an extension function icon EI associated with the image-recording function and a plurality of accompanying sub-icons SI to be superimposed and displayed on the display window of the external application, as depicted in <FIG>.

In such a case, as depicted in the figure, the controller <NUM> according to the present embodiment may cause a preview of the image photographed by the image capturing unit <NUM>, to be superimposed and displayed as the extension function icon EI. According to the control, the user can check the user's own image before starting the image-recording, so that the user can make preparations for tidying him/herself and the like.

Note that a sub-icon SI1 may be an icon for the user to issue an instruction to end the image-recording function. In the case where the sub-icon SI1 is selected, the controller <NUM> may perform control such that the extension function icon EI and all sub-icons SI are not displayed while the extended menu icon MI is superimposed and displayed again.

Further, a sub-icon SI2 may be an icon for the user to issue an instruction to control the manner of sound-recording in association with the image-recording of the external application. The controller <NUM> according to the present embodiment is capable of dynamically controlling the manner of the sound-recording described above on the basis of the user's operation of the sub-icon SI2. For example, the controller <NUM> may dynamically switch between on and off of the sound-recording described above, on the basis of the operation of the sub-icon SI2.

Further, a sub-icon SI3 may be an icon for the user to issue an instruction to start and end the photographing by the image capturing unit <NUM>. The controller <NUM> according to the present embodiment is capable of dynamically controlling both the photographing by the image capturing unit <NUM> and the superimposing and displaying of the photographed image, on the basis of the user's operation of the sub-icon SI3. The sub-icon SI3 for starting and ending the photographing is disposed apart from the icon for starting and ending the image-recording function. Therefore, the user can check the user's own image before starting the photographing, so that the user can make preparations for tidying him/herself and the like.

Further, a sub-icon SI4 may be an icon for the user to issue an instruction to start and end the image-recording function. The controller <NUM> according to the present embodiment may control the start and end of the image-recording function, on the basis of the user's operation of the sub-icon SI4.

Up to this point, the description has been made regarding the example of the sub-icons SI according to the present embodiment. In this way, with the extended applications according to the present embodiment, the user can flexibly and dynamically set the superimposition of a photographed image, the manner of sound-recording, and any other related operation, and then perform the recording of image of the playing status.

Note that, similarly to the extended menu icon MI, the extension function icon EI according to the present embodiment may optionally be adjusted regarding its display position. In such a case, the controller <NUM> according to the present embodiment controls the display positions of the sub-icons SI on the basis of the display position of the extension function icon EI.

More specifically, on the basis of the display position of the extension function icon EI, the controller <NUM> according to the present embodiment may cause the sub-icons SI to be displayed at the circumference of the extension function icon such that the sub-icons SI can fit inside the display window.

For example, in the case of one example depicted on the upper left side of <FIG>, the extension function icon EI is disposed in the upper left corner on the display window. In such a case, the controller <NUM> may cause the sub-icons SI1 to SI4 to be displayed on the right and lower sides of the extension function icon EI.

Further, for example, in the case of one example depicted on the upper right side of <FIG>, the extension function icon EI is disposed in the upper right corner on the display window. In such a case, the controller <NUM> may cause the sub-icons SI1 to SI4 to be displayed on the left and lower sides of the extension function icon EI.

Further, for example, in the case of one example depicted on the lower left side of <FIG>, the extension function icon EI is disposed in the lower left corner on the display window. In such a case, the controller <NUM> may cause the sub-icons SI1 to SI4 to be displayed on the upper and right sides of the extension function icon EI.

Further, for example, in the case of one example depicted on the lower right side of <FIG>, the extension function icon EI is disposed in the lower right corner on the display window. In such a case, the controller <NUM> may cause the sub-icons SI1 to SI4 to be displayed on the upper and left sides of the extension function icon EI. Note that <FIG> depicts the examples of display of the sub-icons SI1 to SI4 in the case where the extension function icon EI is disposed in any one of the four corners on the display window. On the other hand, the display of such sub-icons SI1 to SI4 as described above is not limited to the case where the extension function icon EI is disposed in one of the four corners on the display window. That is, in the case where the display window is split into four parts, i.e., in two vertical columns by two horizontal rows, the display of the sub-icons is controlled according to the region in which the extension function icon EI is disposed. For example, in the case depicted in <FIG>, when the extension function icon EI is in a state of being disposed in the upper left region of the display window, the sub-icons SI1 to SI4 are displayed on the right and lower sides of the extension function icon EI. In the case where the user drags the extension function icon EI and the extension function icon EI is then moved to the upper right region of the display window, the sub-icons SI1 to SI4 are displayed on the left and lower sides of the extension function icon EI.

According to the control as described above, it is possible to avoid encountering the situation in which, in the case where the sub-icons SI are moved accompanying the extension function icon EI, the sub-icons partly hide outside the display window, and thus, part of the functions become unavailable. Note that, during moving the extension function icon EI to any position on the display window by dragging the extension function icon EI, the display state may be made such that the sub-icons SI1 to SI4 are not displayed while only the extension function icon EI is displayed. With such a configuration, the amount of information displayed on the screen is reduced, so that the user can easily concentrate on moving the icon. In such a case, after the dragging operation for the moving is finished and the user releases the user's finger from, for example, the display unit <NUM> provided to serve as a touch panel, the controller <NUM> can cause the sub-icons SI1 to SI4 to be displayed again.

Next, control performed after the image-recording is started will be described. As described above, the controller <NUM> according to the present embodiment is capable of starting the image-recording function on the basis of the user's operation of the sub-icon SI4. In such a case, as depicted in <FIG>, the controller <NUM> may cause the sub-icons SI1 to SI4 not to be displayed and may provide the extension function icon EI with a visual effect indicating that the image-recording is being performed. According to the control, it is possible to prevent unnecessary information such as the sub-icons SI from being recorded together. Further, in a state in which the photographing had been started by the operation of the sub-icon SI3, the display state becomes such that an image of a user's face or the like photographed by the image capturing unit <NUM> is superimposed and displayed as the extension function icon EI, as depicted in <FIG>, and an image of facial expressions of the user playing the external application can thus be recorded.

In addition, even after the image-recording has been started, the extension function icon EI may be movable to any position. For example, the user can perform a dragging operation or the like according to the situation of the external application, thereby moving the extension function icon EI to a position where the icon does not obstruct user's operations.

Note that such moving of the extension function icon EI as described above may automatically be performed by the controller <NUM>. The controller <NUM>, through analysis of images associated with the external application, may automatically move the extension function icon EI into a region in the screen in which less movement appears or no UI such as a button for the user to operate is disposed. In addition, the controller <NUM>, through learning of user's operations for moving, may move the extension function icon EI to an optimum display position according to the status of the game, for example. The controller <NUM> may perform such an automatic positional control as described above for the extended menu icon MI as well.

Further, setting that relates to the sound-recording and the superimposed display of a photographed image may be changeable any time even after the image-recording has been started.

In the case where the extension function icon EI is pressed and selected by the user after the image-recording has started, the controller <NUM> causes the sub-icons SI to be superimposed and displayed again on the display window as depicted in <FIG>, thereby offering a state in which the user can perform various kinds of settings. At this time, the controller <NUM> may change the display from the display associated with the sub-icon SI4 to a visual effect for issuing an instruction to end the image-recording. The user can press the sub-icon SI4 to issue the instruction to end the image-recording. Note that the user may press the extension function icon EI again such that the sub-icons SI are caused again not to be displayed. Further, even in the state in which the sub-icons SI are displayed together with the extension function icon E1, during moving the extension function icon EI to any position on the display window by dragging the extension function icon EI, the display state may be made such that the sub-icons SI are not displayed while only the extension function icon EI is displayed.

Further, for example, the user may press the sub-icon SI3 to change the operations, i.e., photographing of an image by the image capturing unit <NUM> and the presence and absence of the superimposed display of the photographed image. With the extended application according to the present embodiment, even after the image-recording has started, it is possible to dynamically change the presence and absence of the superimposed display of the photographed image according to the situation.

Further, in a similar way to this, the user may press the sub-icon SI2 to change the manner of the sound-recording, for example. In <FIG>, one example of the case is depicted in which the display of the sub-icon SI2 changes according to a mode, each time the sub-icon SI2 is pressed.

For example, a sub-icon SI2a indicates a mode of not performing the sound-recording. Further, a sub-icon SI2b indicates a mode of performing the sound-recording of only the sound output by the external application. Further, a sub-icon SI2c indicates a mode of performing the sound-recording of both the sound output by the external application and the sound uttered by the user. Further, a sub-icon SI2d indicates a mode of performing the sound-recording of only the sound uttered by the user. In this way, the manner of the sound-recording according to the present embodiment may include on and off of sound-recording and modes of sound-recording.

The controller <NUM> according to the present embodiment controls the change of mode as described above which is selected by the user's operation of the sub-icon SI2, and controls the sound-recording according to each mode. With such control, it is possible to dynamically select the on and off of sound-recording and the sounds to be recorded according to the situation, so that more flexible production of moving images can be realized.

Note that, in <FIG>, the description of the example of the case has been made by using the example in which the state of the sub-icon SI2 changes each time the sub-icon SI2 is pressed; however, the controller <NUM> may cause a plurality of additional icons for designating the mode of sound-recording, to be superimposed and displayed at the circumference of the sub-icon SI2, for example.

Up to this point, the description has been made regarding the dynamic changes of setting according to the present embodiment after the image-recording has started. With the above-described functions of the extended application according to the present embodiment, it is possible to dynamically and flexibly change the content to be recorded, according to the playing status or the like of an external application, so that it is possible to realize production of moving images in which user's intention is reflected more.

Note that the above-described setting of the image-recording function is merely an example. The image-recording function according to the present embodiment is capable of performing various kinds of settings other than the superimposed display of a photographed image and the sound-recording. For example, the controller <NUM> according to the present embodiment may control the release of a recorded image to an external service.

In an example depicted in <FIG>, a sub-icon SI5 may be an icon for the user to issue an instruction to release a recorded moving image to an external service. The controller <NUM> according to the present embodiment is also capable of dynamically controlling the release of recorded moving images to various external services on the basis of the user's operation of the sub-icon SI5.

In such a case, the user may be able to pre-set an external service as a destination for the release or able to optionally select an external service as a destination for the release through the user's operation of the sub-icon SI5. With this, it is possible to distribute, on a real time basis, a moving image recorded together with a recorded image of a playing status via one or more external services.

Further, in the above description, the example of the case has been explained in which an image photographed by the image capturing unit <NUM> is superimposed and displayed on the display window and is recorded together with the playing status; however, the image to be superimposed and displayed is not limited to the image photographed by the image capturing unit <NUM>.

The controller <NUM> may acquire, for example, a moving image associated with the playing status of another user who is playing the game together with the user via a network, an image produced by photographing such another user, and any other related image, and may then cause the acquired image to be superimposed and displayed. Further, the controller <NUM> may cause an avatar or the like to be superimposed and displayed by animation in place of the photographed image of the user.

In this way, the image to be superimposed and displayed on the display window may optionally be set by the user. In such a case, the sub-icon SI2 associated with the superimposed display may be an icon for the user to issue an instruction to change the presence and absence of the superimposed display of various acquired images and to determine the kind of image to be superimposed and displayed.

Next, descriptions will be made regarding an example of a hardware configuration of the information processing apparatus <NUM> according to one embodiment of the present disclosure. <FIG> depicts a diagram for illustrating an example of the hardware configuration of the information processing apparatus <NUM> according to the embodiment of the present disclosure. As depicted in <FIG>, the information processing apparatus <NUM> includes a processor <NUM>, a ROM <NUM>, a RAM <NUM>, a host bus <NUM>, a bridge <NUM>, an external bus <NUM>, an interface <NUM>, an input device <NUM>, an output device <NUM>, a storage <NUM>, a drive <NUM>, a connection port <NUM>, and a communication device <NUM>, for example. Note that the hardware configuration described herein is only an example; therefore, some of the constituent elements may be omitted. Further, constituent elements other than the constituent elements described herein may be further included.

The processor <NUM> functions as an arithmetic processing device or a control device, for example, and controls all or part of operations of each of the constituent elements on the basis of various programs that are stored in the ROM <NUM>, the RAM <NUM>, the storage <NUM>, or a removable recording medium <NUM>.

The ROM <NUM> is means that stores programs to be loaded into the processor <NUM>, data to be used for computing, or the like. In the RAM <NUM>, for example, programs to be loaded into the processor <NUM>, various parameters that appropriately change in executing the programs, etc., are stored temporality or permanently.

The processor <NUM>, the ROM <NUM>, and the RAM <NUM> are mutually connected, for example, via the host bus <NUM> capable of high-speed data transmission. On the other hand, the host bus <NUM> is connected, via the bridge <NUM>, to the external bus <NUM> capable of relatively low-speed data transmission, for example. Further, the external bus <NUM> is connected to various constituent elements via the interface <NUM>.

The input device <NUM> employs a mouse, a keyboard, a touch panel, a button, a switch, and a lever, for example. In addition, in some cases, the input device <NUM> employs a remote controller (hereinafter, referred to as a remote) capable of transmitting a control signal by using infrared rays or any other radio wave. Further, the input device <NUM> includes a sound input device such as a microphone.

The output device <NUM> is a device which is capable of visually or audibly notifying a user of acquired information. Examples of such a device include a display device such as a CRT (Cathode Ray Tube), an LCD, or an organic EL, an audio output device such as a loudspeaker or headphone, a printer, a mobile phone, a facsimile, and any other terminal. Further, the output device <NUM> according to the present disclosure includes various kinds of vibration devices capable of outputting tactile stimulation.

The storage <NUM> is a device that stores various kinds of data. The storage <NUM> includes, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or any other storage device.

The drive <NUM> is a device that reads out information stored in the removable recording medium <NUM> such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or any other record medium, and that writes information in the removable recording medium <NUM>, for example.

The removable recording medium <NUM> includes, for example, a DVD medium, a Blu-ray (registered trademark) medium, an HD DVD medium, various kinds of semiconductor storage media, and any other record medium. Needless to say, the removable recording medium <NUM> may also be, for example, an IC card equipped with a non-contact IC chip, an electronic device, or the like.

The connection port <NUM> is a port for connection of an external connection device <NUM>. Examples of the port include a USB (Universal Serial Bus) port, an IEEE1394 port, an SCSI (Small Computer System Interface), an RS-232C port, an optical audio terminal, and any other connection port.

The external connection device <NUM> includes, for example, a printer, a portable music player, a digital camera, a digital video camera, an IC recorder, and the like.

The communication device <NUM> is a communication device for connection to a network. Examples of the communication device include a communication card for a wired or wireless LAN, Bluetooth (registered trademark), or WUSB (Wireless USB), a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), a modem for various kinds of communication, and any other communication device.

As described above, the information processing apparatus <NUM> according to the embodiment of the present disclosure includes the controller <NUM> that controls the functional extension of an external application. Further, one of the features of the controller <NUM> according to the embodiment of the present disclosure is to cause an extended menu icon whose display position is adjustable, to be superimposed and displayed on the display window of the external application, and is to control the display position of an extended menu according to the display position of the superimposed-displayed extended menu icon. In addition, one of the features of the controller <NUM> according to the embodiment of the present disclosure is to cause an extension function icon associated with the extension function selected on the above-described extended menu to be superimposed and displayed on the above-described display window, with the display position of the extension function icon being adjustable, and is to control the display position of a sub-icon accompanying the superimposed-displayed extension function icon, according to the display position of the extension function icon. According to the configuration, it is possible to provide the extension function that permits more intuitive operations without interfering with the behavior of the external application.

While the preferred embodiments of the present disclosure have been described above in detail with reference to the accompanying drawings, the present disclosure is not limited to the above examples. It is obvious that a person skilled in the art may find various alterations and modifications within the scope of the appended claims, and it should be understood that such alterations and modifications will naturally fall within the technical scope of the present disclosure.

Further, the effects described in the present specification are merely illustrative or exemplified effects, and are not limitative. That is, with or in the place of the above effects, the technology according to the present disclosure may achieve other effects that are clear to those skilled in the art from the description of the present specification.

Claim 1:
An information processing apparatus (<NUM>) comprising:
a controller (<NUM>) configured to control functional extension of an external application, wherein
the controller is configured to
cause an extended menu icon (MI) whose display position is adjustable to be superimposed and displayed on a display window of the external application, wherein the display position of the extended menu icon is adjustable to any position on the display window, and control a display position of an extended menu according to the display position of the extended menu icon when selecting the extended menu icon (MI), the extended menu comprising a menu of extension functions, and
cause an extension function icon (EI) to be superimposed and displayed on the display window with a display position of the extension function icon being adjustable to any position on the display window, the extension function icon (EI) being associated with an extension function selected on the extended menu, and control a display position of a plurality of sub-icons (SI) accompanying the extension function icon, according to the display position of the extension function icon (EI).