Patent Description:
Recently, a technology of supporting an operation by a finger of a user in a device having a touch panel has been developed. For example, in Patent Literature <NUM>, a technology in which a position of a controller displayed on a screen is controlled on the basis of a position of a finger of a user which position is detected by a sensor included in a back surface of the device is disclosed.

However, in the technology disclosed in Patent Literature <NUM>, a device needs to additionally include a sensor to detect a finger. Also, there is a case where the technology disclosed in Patent Literature <NUM> cannot optimize an operation in a small device such as a smartphone used with one hand.

Thus, the present disclosure proposes an information processing device and an information processing method capable of reducing an operational burden of a small terminal that has a touch panel and that is used with one hand.

Prior art includes: <CIT>, <CIT>, <CIT> and <CIT>. Each of these prior art documents describes a prior art device.

As described above, according to the present disclosure, it becomes possible to reduce an operational burden of a small terminal that has a touch panel and that is used with one hand.

Note that the above effect is not necessarily a limitation, and any of the effects described in the present description, or other effects that can be grasped from the present description may be acquired in addition to or instead of the above effect.

Note that the same signs are assigned to components having substantially the same functional configurations in the present description and drawings, and overlapped description thereof is omitted.

Note that the description will be made in the following order.

<FIG> is a view illustrating an example of an external configuration of an information processing terminal <NUM> of the present disclosure. On a left side of <FIG>, a front surface of the information processing terminal <NUM> is illustrated. Also, a back surface of the information processing terminal <NUM> is illustrated on a right side of <FIG>. The information processing terminal <NUM> is, for example, a smartphone. Also, the information processing terminal <NUM> may be a tablet terminal.

The information processing terminal <NUM> includes a display <NUM>. The display <NUM> covers a sensor unit <NUM> (described later). With such a configuration, the information processing terminal <NUM> can detect a finger of a user in contact with the display <NUM>. Note that the display <NUM> may cover a part or whole of a side surface of the information processing terminal <NUM>.

Also, the information processing terminal <NUM> can control contents of a display screen on the basis of a user input. For example, the information processing terminal <NUM> can display execution information related to function execution of an application on the display <NUM> by using a so-called graphical user interface (GUI). Here, the execution information means visual information such as an icon causing an application to execute predetermined processing, a result of execution of the predetermined processing by the application, and the like.

The information processing terminal <NUM> includes, for example, a camera <NUM> and a display <NUM>. Here, the camera <NUM> may be provided in one or both of the front surface and the back surface of the information processing terminal <NUM>, as illustrated in <FIG>.

Next, an example of the functional configuration of the information processing terminal <NUM> according to the present embodiment will be described. <FIG> is a view for describing an example of the functional configuration of the information processing terminal <NUM> according to the present embodiment. As illustrated in <FIG>, the information processing terminal <NUM> is an information processing device including a sensor unit <NUM>, an input unit <NUM>, a storage unit <NUM>, a camera <NUM>, a control unit <NUM>, a display <NUM>, a specification unit <NUM>, and a communication unit <NUM>.

The sensor unit <NUM> according to the present embodiment has a function of detecting a contact made by a finger of a user with the information processing terminal <NUM>. Here, the sensor unit <NUM> can detect a position of the finger of the user in contact with the front surface and the side surface of the information processing terminal <NUM>. Note that the sensor unit <NUM> is realized, for example, by a capacitance-type touch sensor or a pressure sensitive-type touch sensor. Note that in a case of the capacitance-type touch sensor, operation using a side surface may be realized without an arrangement of a touch sensor immediately below the side surface portion of the information processing terminal <NUM> by setting such that sensitivity of a touch sensor, which is arranged immediately below the front surface of the information processing terminal, in a direction of the side surface becomes high. In this case, when the sensitivity of the side surface portion of the information processing terminal <NUM> is set to be higher than that of a touch sensor in other regions, the operation using the side surface is realized.

Also, the sensor unit <NUM> may detect a position of an operating finger that executes a trigger operation. Here, the trigger operation means an operation for causing an application to execute predetermined processing, or an operation for causing a result of the execution of the predetermined processing by the application to be displayed. Also, the trigger operation specifically refers to a tap, double-tap, push, and the like. In addition, the operating finger means, among a plurality of fingers of a user that holds the information processing terminal <NUM>, a finger that executes an operation on the display <NUM> in order to cause the application to execute predetermined processing.

The input unit <NUM> according to the present embodiment includes various sensors such as an acceleration sensor and a position information sensor, and has a function of acquiring data by using the various sensors. The input unit <NUM> provides the acquired data to the specification unit <NUM> (described later).

The storage unit <NUM> according to the present embodiment is a storage area to temporarily or permanently store various kinds of programs and data. The storage unit <NUM> may store information related to various applications, for example. More specifically, for example, the storage unit <NUM> may store a program for executing an application, and management data to manage various settings and the like. Obviously, the above is merely an example, and a type of data stored in the storage unit <NUM> is not specifically limited.

The camera <NUM> according to the present embodiment is used for photographing processing of an image or moving image under control of a photographic application. Here, the photographic application means an application capable of photographing an image or a moving image. Note that the camera <NUM> is provided in one or both of the front surface and the back surface of the information processing terminal <NUM>.

The control unit <NUM> according to the present embodiment has a function of determining, on the basis of a detection position of an operating finger on the side surface of the information processing terminal <NUM> which position is detected by the sensor unit <NUM>, a region to receive an operation by the operating finger. Also, here, the detection position of the operating finger means a position where an operation on the side surface of the information processing terminal <NUM> is executed among positions where the operation finger executes an operation on the information processing terminal <NUM>.

A detailed description will be made. The control unit <NUM> determines a region to display predetermined information on a display screen on the basis of a detection position of an operating finger that executes a trigger operation on the side surface, the position being detected by the sensor unit <NUM>. Also, the control unit <NUM> determines a region to receive a subsequent operation by the operating finger from a region, which is a combination of the display screen and the side surface, on the basis of the detection position of the operating finger that executes the trigger operation on the side surface which position is detected by the sensor unit <NUM>. Here, on the basis of the detection position, the control unit <NUM> may determine a region assumed to be reached by the operating finger as a region to receive an operation.

Here, the subsequent operation means an operation executed on the region determined by the control unit <NUM> on the basis of the detection position of the operating finger that executes the trigger operation.

Note that there is a case where the control unit <NUM> determines a region to receive an operation by the operating finger on the basis of a detection position where the sensor unit <NUM> detects a finger other than the operating finger of the user.

In such a manner, by receiving the operation on the region assumed to be reached by a finger of the user, it is possible to reduce a burden on the user of an operation with respect to the information processing terminal <NUM>.

Also, the control unit <NUM> may cause the display <NUM> to display execution information related to function execution of an application in a case where the sensor unit <NUM> detects that the trigger operation is executed by the operating finger on the side surface.

The control unit <NUM> has a function of causing various applications to execute predetermined processing on the basis of an operation related to function execution of the application by the finger of the user. The operation related to the function execution of the application includes, for example, a touch operation on an icon of the application. Also, the function execution of an application includes execution of functions unique for various applications.

For example, the control unit <NUM> can control photographing processing of the photographic application. More specifically, the control unit <NUM> can perform control in such a manner that the photographic application photographs an image or moving image with the camera <NUM>. Also, the control unit <NUM> may cause the display <NUM> (described later) to display information related to the photographing processing. Here, the information related to the photographing processing means a preview image expressing a result of the photographing processing, a controller to control the photographing processing, and the like.

Also, the control unit <NUM> has a function of controlling each configuration included in the information processing terminal <NUM>. The control unit <NUM> controls, for example, starting and stopping of each component.

The display <NUM> according to the present embodiment is a touch panel having a function of displaying execution information related to function execution of an application on a display screen under control by the control unit <NUM>.

The specification unit <NUM> according to the present embodiment has a function of specifying a predetermined application on the basis of predetermined criteria. Here, the predetermined criteria are, for example, current time, a current location, a frequency of use of various applications, and the like. For example, the specification unit <NUM> may specify an application used more frequently than other applications among various applications stored in the storage unit <NUM>.

The specification unit <NUM> may specify an application by using a model constructed by machine learning of an operation by the user on the information processing terminal <NUM> or of predetermined criteria. The machine learning may be machine learning using a neural network such as deep learning. Note that the constructed model may be stored in the storage unit <NUM>.

Also, the specification unit <NUM> may specify an application by using information acquired by machine learning from data that is related to terminal usage by a plurality of users and that is received from other devices via a network <NUM> (described later). Execution information related to the application may be displayed to the user by the display <NUM> controlled by the control unit <NUM>.

The communication unit <NUM> according to the present embodiment has a function of executing communication with other devices via the network <NUM> (described later). For example, the communication unit <NUM> may receive, from the other devices, information acquired by machine learning from the above-described data related to terminal usage by a plurality of users.

The network <NUM> according to the present embodiment has a function of connecting the components included in the information processing system. The network <NUM> may include the Internet, a public line network such as a telephone line network or a satellite communication network, various local area networks (LAN) including Ethernet (registered trademark), a wide area network (WAN), and the like. Also, the network <NUM> may include a leased line network such as an Internet protocol-virtual private network (IP-VPN). Also, the network <NUM> may include a wireless communication network such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).

In the above, an example of a functional configuration of the information processing terminal <NUM> according to the present embodiment has been described. Note that the functional configuration described above with reference to <FIG> is merely an example, and the functional configuration of the information processing terminal <NUM> according to the present embodiment is not limited to this example. For example, the information processing terminal <NUM> does not necessarily include all of the configurations illustrated in <FIG>. For example, the storage unit <NUM>, the camera <NUM>, and the specification unit <NUM> can be included in another device different from the information processing terminal <NUM>. The functional configuration of the information processing terminal <NUM> according to the present embodiment can be flexibly modified according to specifications and operation.

Also, functions of the components may be executed when an arithmetic unit such as a central proccessing unit (CPU) reads a control program describing a processing procedure to realize these functions from a storage medium such as a read only memory (ROM) or a random access memory (RAM) storing the control program, and interprets and executes the program. Thus, it is possible to appropriately change a configuration to be used according to a technical level at the time of performance of the present embodiment. An example of a hardware configuration of the information processing terminal <NUM> will be described later.

Next, an operation of the control unit <NUM> according to the present embodiment will be described in detail with a detailed example.

<FIG> is a view illustrating an example of displaying an icon of an application on the basis of a detection position of a trigger operation on the side surface according to the present embodiment. On a left side of <FIG>, the information processing terminal <NUM> held by a hand of a user is illustrated. The information processing terminal <NUM> includes a display <NUM>.

On the left side of <FIG>, when a trigger operation is executed by an operating finger F on a side surface of the information processing terminal <NUM>, the control unit <NUM> determines a region to display an icon of an application on the display <NUM>, which is a display screen, on the basis of a detection position TP1 of the operating finger F. On a right side of <FIG>, icons I1 of a plurality of applications are displayed on the display <NUM> as execution information related to function execution of the applications on the basis of the detection position.

In the example on the left side of <FIG>, when the sensor unit <NUM> detects a double-tap operation executed by the operating finger F at a detection position TP1, the control unit <NUM> causes the display <NUM> to display the icons I1 of the plurality of applications.

In the example on the right side of <FIG>, the control unit <NUM> causes the icons I1 of the plurality of applications to be displayed with a height on the display screen, which height corresponds to the detection position TP1 on the side surface, as the uppermost row. Here, the icons I1 are displayed in a region assumed to be reached by the operating finger F. Also, in the example on the right side of <FIG>, the control unit <NUM> determines, as the region assumed to be reached by the operating finger F, a region on the right side of the entire display <NUM>. Obviously, an arrangement of the icons displayed on the display screen by the control unit <NUM> is not limited to this example.

For example, in a case where the user executes, as the subsequent operation, a touch operation on any one of the icons I1 of the plurality of applications, the control unit <NUM> may execute starting processing of an application corresponding to an icon on which the touch operation is executed.

Also, an application related to a displayed icon can be specified by the specification unit <NUM> on the basis of predetermined criteria. The control unit <NUM> causes the display <NUM> to display icons I1 of a plurality of applications specified by the specification unit <NUM>. Here, for example, the control unit <NUM> may cause the display <NUM> to display an icon of a more-frequently-used application at a high position on the display screen compared to compared to icons of other applications.

Note that in a case where the sensor unit <NUM> detects a slide operation by the operating finger F on the display screen, the control unit <NUM> may control the icons of the plurality of applications to scroll vertically, for example. By the control, even in a case where icons of many applications are displayed, the user can execute an operation related to the starting processing of an application.

In such a manner, the information processing terminal <NUM> can display icons of applications on the basis of a detection position of a finger of a user. With such a function, it becomes possible to reduce a burden on the user of the operation related to the starting processing of an application.

Note that with respect to the display <NUM> that is a display screen, the control unit <NUM> may also determine a region to display execution information related to an application that does not require a subsequent operation and that is, for example, a clock application or the like on the basis of the detection position TP1 of the operating finger F.

In the above, an example in which the information processing terminal <NUM> displays icons of applications has been described. Here, the information processing terminal <NUM> may execute processing related to an active application in a case where a trigger operation on the side surface of the information processing terminal <NUM> is detected.

<FIG> is a view illustrating an example of image photographing processing by a photographic application using the side surface according to the present embodiment. In <FIG>, the information processing terminal <NUM> in which the photographic application is active is illustrated.

On a left side of <FIG>, a scenery projected by the camera <NUM> is displayed on the display <NUM>. In a case where the sensor unit <NUM> detects execution of a trigger operation by the operating finger F on the side surface of the information processing terminal <NUM>, the control unit <NUM> causes the photographic application to execute image photographing processing.

Here, for example, in a case where the sensor unit <NUM> detects execution of a double-tap operation, the control unit <NUM> may cause the photographic application to execute the photographing processing after a predetermined period. This is because the information processing terminal <NUM> shakes due to the double-tap immediately after the double-tap operation by the user and a still image with a blurred picture may be photographed even when the photographing processing is executed. Here, the control unit <NUM> may cause the display <NUM> to display a figure or a character of a predetermined icon (such as icon indicating that photographing processing is in progress) or the like on the basis of a detection position TP2 during standing by for elapse of the predetermined period before the photographic application starts executing the photographing processing. The displayed icon is hidden after the elapse of the predetermined period. Note that the standby and display of icons and the like after the double-tap operation are the similar in moving image photographing processing (described later).

On a right side of <FIG>, the control unit <NUM> causes the display <NUM> to display, as a preview image W1, a result image photographed by the photographic application of the operating finger that executes the trigger operation on the side surface. Here, the preview image means, for example, a result that is acquired by execution of the photographing processing by the photographic application and that is for the user to check a photographed image or moving image. For example, a thumbnail image of a photographed image can be displayed as a preview image.

In the example on the right side of <FIG>, the control unit <NUM> causes the display <NUM> to display the preview image W1 on the basis of the detection position TP2 of the operating finger that executes the double-tap operation on the side surface, the position being detected by the sensor unit <NUM>. Here, the preview image W1 is displayed with a height on the display screen, which height corresponds to the detection position TP2, as a reference. Here, the control unit <NUM> causes the display <NUM> to make a display at a position and with a size assumed to be reached by the operating finger F.

Note that, for example, in a case where the sensor unit <NUM> detects an operation such as a touch by the operating finger F on the preview image W1, the control unit <NUM> may cause the image photographed by the photographic application to be displayed on the entire display <NUM>. Note that the control unit <NUM> may cause the photographic application to stand by for a predetermined period before the photographic application is caused to execute the photographing processing after the trigger operation executed on the side surface by the operating finger is detected.

In such a manner, the information processing terminal <NUM> can photograph an image and display a preview image on the basis of the trigger operation by the operating finger on the side surface. With such a function, it becomes possible for the user to perform photographing while holding the information processing terminal without difficulty.

In the above, an example in which the information processing terminal <NUM> causes the photographic application to photograph an image has been described. However, application to an example of executing photographing of a moving image is also possible. <FIG> is a view illustrating an example of a moving image photographing processing of the photographic application on the side surface according to the present embodiment. In <FIG>, the information processing terminal <NUM> in which the photographic application is active is illustrated.

On a left side of <FIG>, a scenery is displayed on the display <NUM> by the camera <NUM>. In a case where the sensor unit <NUM> detects execution of a trigger operation by the operating finger F on the side surface of the information processing terminal <NUM>, the control unit <NUM> causes the photographic application to start photographing of a moving image.

In the middle of <FIG>, the control unit <NUM> causes the photographic application to photograph a moving image. Also, during execution of the photographing, the control unit <NUM> causes the display <NUM> to display a controller C on the basis of a detection position TP3 at which the trigger operation is executed and which is detected by the sensor unit <NUM>. Here, the controller is a button to control photographing processing by the photographic application. For example, in a case where the sensor unit <NUM> detects an operation by the operating finger F on a region in an upper part of the controller C, the control unit <NUM> may cause the photographic application to end the photographing of a moving image, for example. Also, in a case where an operation on a region at a center of the controller C is detected, for example, the photographing of a moving image by the photographic application may be temporarily stopped. Also, in a case where an operation on a region in a lower part of the controller C is detected, for example, the photographic application may be caused to execute photographing of a still image. Also, in a case where the sensor unit <NUM> detects a predetermined operation such as a double-tap operation by the operating finger F on the side surface, the control unit <NUM> may cause the photographic application to end the photographing of a moving image.

On a right side of <FIG>, the control unit <NUM> causes the display <NUM> to display a preview image W2, which is a result moving image photographed by the photographic application, following the processing of ending the photographing of a moving image. Here, for example, the preview image W2 may be displayed on the display <NUM> with a height on the display screen, which height corresponds to a detection position TP3, as a reference. Also, for example, a thumbnail image corresponding to a first scene of a moving image can be displayed as the preview image W2.

In such a manner, the information processing terminal <NUM> can photograph a moving image and display a preview image on the basis of the trigger operation by the operating finger on the side surface. With such a function, it becomes possible for the user to perform moving image photographing while holding the information processing terminal without difficulty.

In the above, an example in which a region to receive an operation on the display screen is determined on the basis of a detection position of a trigger operation on the side surface of the information processing terminal <NUM> has been described. However, a region to receive an operation by a finger of a user on the side surface of the information processing terminal <NUM> may be determined on the basis of the detection position.

<FIG> is a view for describing an example of determining a region to receive an operation on the side surface of the information processing terminal <NUM> according to the present embodiment. In <FIG>, the information processing terminal <NUM> held by a hand of a user is illustrated. Note that in the example of <FIG>, the information processing terminal <NUM> causes the display <NUM> to display an active Internet browser.

In <FIG>, the control unit <NUM> determines a position to receive an operation related to execution of an application on the side surface on the basis of a position of a finger of the user. In an example on a left side of <FIG>, the control unit <NUM> is in a state of receiving an operation by a finger of the user only on a right side surface S1 of the information processing terminal <NUM>. In other words, the control unit <NUM> is in a state of not receiving an operation by a finger of the user on a left side surface S2 of the information processing terminal <NUM>. Here, when the user slides an operating finger F on the right side surface S1 of the information processing terminal <NUM>, for example, the Internet browser executes "return" processing, for example.

In an example on the right side of <FIG>, the control unit <NUM> causes the display <NUM> to display a previous page of a page displayed on the left side of <FIG>.

Here, the control unit <NUM> may determine, as a region (side surface) to receive an operation related to function execution of an application, a side surface on which an operation is assumed to be executed by the operating finger of the user between the right and left side surfaces of the information processing terminal <NUM>. Note that in a case of the example illustrated in <FIG>, the operating finger is a thumb. The region may be manually set by the user.

In such a manner, it is possible to determine a region to receive an operation on the side surface of the information processing terminal <NUM>. With such a function, it is possible to prevent erroneous generation of processing.

Also, processing executed by the control unit <NUM> in a case where the sensor unit <NUM> detects execution of an operation on the side surface is not limited to the above example. For example, the control unit <NUM> may execute processing of adjusting an output volume of the information processing terminal <NUM> in a case where the sensor unit <NUM> detects a slide operation on the side surface.

In the above, an example of determining a region to receive an operation on the side surface has been described. However, it is also possible to prevent erroneous generation of processing by limiting a region to receives an operation on the side surface.

<FIG> is a view for describing an example of limiting a region to receive an operation on the side surface of the information processing terminal <NUM> according to the present embodiment. In <FIG>, an information processing terminal <NUM> including a display <NUM> on which icons I2 of a plurality of applications are displayed is illustrated.

In <FIG>, the control unit <NUM> limits a region to receive an operation by a finger of a user on a side surface with a height on a display screen, which height corresponds to a detection position of an operating finger on the side surface, as a reference.

In the example of <FIG>, the control unit <NUM> determines a region R1 and a region R2 on the basis of a detection position TP4a of an operating finger F executing a trigger operation, which position is detected by the sensor unit <NUM>, among detection positions TP4a, TP4b, and TP5 to TP7. Here, for example, as a region to receive an operation by a finger of the user, the control unit <NUM> determines that an operable side surface R1a that is a right side surface of the region R1 is a region assumed to be reached by the operating finger F. Also, the control unit <NUM> may determine, as a region not to receive an operation by a finger of the user, a left side surface of the region R1 and right and left side surfaces of the region R2, that is, a region other than the operable side surface R1a.

In the example of <FIG>, a case where the trigger operation is executed by the operating finger F has been described. However, the control unit <NUM> determines a region R1 and a region R2 on the basis of a positional relationship between a plurality of fingers of a user which relationship is detected by the sensor unit <NUM>, that is, a positional relationship between the detection positions TP4a, TP4b, and TP5 to TP7, for example.

In such a manner, it is possible to limit a region to receive an operation on the side surface, that is, a region in which the sensor unit <NUM> detects an operation on the side surface. With such a function, it becomes possible to efficiently prevent erroneous generation of processing according to a way how the information processing terminal <NUM> is held.

In <FIG>, an example in which the control unit <NUM> limits a region to receive an operation on the side surface has been described. However, for example, the control unit <NUM> may limit a region to receive an operation on the display screen with a height on the display screen, which height corresponds to a detection position of an operating finger on the side surface, as a reference. Also, the control unit <NUM> may limit a region to receive an operation on each of the display screen and the side surface with the height as a reference. With such a function, it becomes also possible to prevent erroneous generation of processing of an operation by a finger of a user on the display screen.

In the above, an example of a case where the information processing terminal <NUM> is used in a vertical direction has been described. However, even in a case where the information processing terminal <NUM> is used in a horizontal direction, an operation using the side surface of the information processing terminal <NUM> is possible.

<FIG> is a view for describing an example of an operation on the side surface in a case where the information processing terminal <NUM> according to the present embodiment is used in the horizontal direction. In <FIG>, the information processing terminal <NUM> in the horizontal direction in which terminal a photographic application is active is illustrated.

In an example in an upper part of <FIG>, a scenery projected by the camera <NUM> is displayed on the display <NUM>. In a case where the sensor unit <NUM> detects execution of a double-tap operation by an operating finger F on the side surface of the information processing terminal <NUM>, the control unit <NUM> causes the photographic application to execute image photographing processing.

In an example in a lower part of <FIG>, the control unit <NUM> causes the display <NUM> to display a result image photographing by the photographic application as a preview image W3. Here, the control unit <NUM> causes the display <NUM> to display the preview image W3 at a detection position TP8 where the sensor unit <NUM> detects the double-tap. As illustrated in the lower part of <FIG>, in a case where the information processing terminal <NUM> is used in the horizontal direction, a position where the double-tap is executed is, for example, an upper side surface of the information processing terminal <NUM>.

With such a function, even in a case where the information processing terminal <NUM> is used in the horizontal direction with one hand, it becomes possible to reduce a burden of the operation.

Also, the information processing terminal <NUM> according to the present embodiment can select an application to be started only on the basis of an operation on the side surface. <FIG> is a view for describing an example of application starting processing based on an operation on the side surface of the information processing terminal <NUM> according to the present embodiment. In <FIG>, the information processing terminal <NUM> held by a hand of a user is illustrated.

In an upper left part of <FIG>, the information processing terminal <NUM> is held by a hand of the user. Here, when the user executes a trigger operation on the side surface of the information processing terminal <NUM> by using an operating finger F, the control unit <NUM> causes the display <NUM> to display icons C1 of a plurality of applications on the basis of a detection position TP9 of the operating finger F executing the trigger operation, the position being detected by the sensor unit <NUM>.

As illustrated in an upper right part of <FIG>, the control unit <NUM> may cause the display <NUM> to display the icons C1 of the plurality of applications in a circular manner centered on the detection position TP9, for example.

Note that the control unit <NUM> may cause the display <NUM> to display icons C2 larger than the icons C1 of the plurality of applications in a case where the sensor unit <NUM> keeps detecting a pushing operation at the detection position TP9. Also, in a case where the sensor unit <NUM> keeps detecting the pushing operation at the detection position TP9, the control unit <NUM> causes the display <NUM> to display icons C3 larger than the icons C2 of the plurality of applications.

As described above, the information processing terminal <NUM> performs displaying in such a manner that icons of a plurality of applications become gradually larger in response to a pushing operation on the side surface by a finger of a user. Thus, the user can easily grasp a status of a series of operations related to the application starting processing.

<FIG> is a view for describing an example of application starting processing based on an operation on the side surface of the information processing terminal <NUM> according to the present embodiment. In <FIG>, the information processing terminal <NUM> held by a hand of a user is illustrated.

In an upper left part of <FIG>, the display <NUM> displays icons C4 of a plurality of applications in a circular manner. Also, here, the user performs a slide operation with an operating finger F on the side surface of the information processing terminal <NUM>. In response to detection of the slide operation via the sensor unit <NUM>, the control unit <NUM> causes the display <NUM> to rotate and display the icons C4 of the plurality of applications displayed in the circular manner.

As illustrated in an upper right part of <FIG>, since the control unit <NUM> rotates the icons C4, an icon <NUM> of an application is displayed at a left center of the circle. Here, the icon <NUM> of the application is different from an icon <NUM> of an application displayed at a left center of a circle in the upper left part of <FIG> Similarly, as illustrated in a lower left part of <FIG>, an icon I5 of an application is different from the icon <NUM> of the application displayed at the left center of the circle in the upper left part of <FIG>.

In the lower left part of <FIG>, for example, in a case where the sensor unit <NUM> detects a pushing operation by an operating finger F at a detection position TP10 on the side surface of the information processing terminal <NUM>, the control unit <NUM> executes starting processing of an application corresponding to the icon I5 displayed right next to the detection position TP10. Here, the control unit <NUM> may perform control such that the icon I5 is displayed larger than the other icons on the display <NUM>, a color of the icon I5 is changed, or the like. By the control, it becomes easy for the user to grasp which icon of the plurality of icons the selected icon is.

Also, in the lower left part of <FIG>, even in a case where the sensor unit <NUM> no longer detects a contact of the operating finger F on the side surface of the information processing terminal <NUM>, in a case where a pushing operation by the operating finger F is subsequently detected on the side surface including TP10, the control unit <NUM> may execute starting processing of the application corresponding to the icon I5 Here, the control unit <NUM> may not execute the pushing operation, that is, the starting processing of the application corresponding to the icon I5 in a case where the sensor unit <NUM> detects the pushing operation at a position on the side surface which position is separated from the detection position TP10 for a predetermined distance or more. This is to prevent erroneous generation of application starting processing.

In the lower right part of <FIG>, a screen of the application corresponding to the icon I5 is displayed on the display screen on the display <NUM>.

In such a manner, the user can execute starting processing of the application without hiding the display <NUM> with a finger of the user, which display functions as the display screen, and without changing a position of an operating finger much. With such a function, it becomes possible to further reduce a burden of an operation by the finger of the user on the side surface of the information processing terminal <NUM>.

An example in which application starting processing is executed only on the basis of an operation on the side surface has been described. Here, the information processing terminal <NUM> may execute screen switching processing of active applications only on the basis of an operation by an operating finger on the side surface. That is, icons displayed in a circular manner on the display <NUM> may be icons of active applications, and the control unit <NUM> can display a screen of a selected active application on the display <NUM>.

Next, an example of a flow of an operation of the information processing terminal <NUM> according to the present embodiment will be described. <FIG> is a view for describing an example of a flow of an icon displaying operation according to the present embodiment.

Referring to <FIG>, first, it is determined whether the sensor unit <NUM> detects a trigger operation on a side surface of the information processing terminal <NUM> (S1001). In a case where the sensor unit <NUM> does not detect the trigger operation (S1001: NO), the operation returns to Step S1001. In a case where the sensor unit <NUM> detects the trigger operation (S1001: YES), the specification unit <NUM> specifies an application on the basis of predetermined criteria (S1002). Then, the control unit <NUM> determines a region to receive an operation by an operating finger on the basis of a height on the display screen which height corresponds to a detection position of the operating finger that executes the trigger operation (S1003).

Then, the control unit <NUM> causes an icon of an application to be displayed on the region determined in Step S1003 (S1004). Then, the sensor unit <NUM> determines whether an operation on the icon of the application which icon is displayed on the display screen of the information processing terminal <NUM> is detected (S1005). In a case where the operation on the icon is detected (S1005: YES), the control unit <NUM> executes starting processing of the application corresponding to the icon (S1006), and the operation is ended. On the one hand, in a case where the trigger operation on the icon is not detected (S1005: NO), it is determined whether an operation such as a double-tap on the side surface of the information processing terminal <NUM> is detected (S1007). In a case where the operation on the side surface is not detected (S1007: NO), the operation returns to Step S1005. In a case where a double-tap operation on the side surface is detected (S1007: YES), the icon displayed in Step S1004 is hidden (S1008), and the operation is ended.

Next, an example of a flow of an image photographing operation by a photographic application according to the present embodiment will be described. <FIG> is a view for describing an example of a flow of an image photographing operation by the photographic application according to the present embodiment.

Referring to <FIG>, first, it is determined whether the sensor unit <NUM> detects a trigger operation on the side surface of the information processing terminal <NUM> in a state in which the photographic application is active in the information processing terminal <NUM> (S1101). In a case where the trigger operation on the side surface is not detected (S1101: NO), the operation returns to Step S1101. In a case where the trigger operation on the side surface is detected (S1101: YES), the control unit <NUM> causes the photographic application to stand by for a predetermined period (S1102). Then, the control unit <NUM> causes the photographic application to execute the image photographing processing (S1103). Then, the control unit <NUM> determines a region to receive an operation by an operating finger on the basis of a height on the display screen, the height corresponding to a detection position at which the trigger operation is executed and which is detected by the sensor unit <NUM> in Step S1101 (S1104).

Then, the control unit <NUM> causes the region on the display <NUM>, which region is determined in Step S1104, to display a preview image of the image photographed in Step S1103 (S1105). Then, it is determined whether the sensor unit <NUM> detects an operation on the preview image displayed on the display screen of the information processing terminal <NUM> (S1106). In a case where the sensor unit <NUM> detects an operation on the preview image (S1106: YES), the control unit <NUM> displays the image photographed in S1103 on the display screen (S1107), and the operation is ended.

On the one hand, in a case where the sensor unit <NUM> does not detect an operation on the preview image (S1106: NO), it is determined whether the sensor unit <NUM> detects an operation on the side surface of the information processing terminal <NUM> (S1108). In a case where the sensor unit <NUM> detects an operation on the side surface (S1108: YES), the control unit <NUM> hides the preview image (S1110), and the operation is ended. On the one hand, in a case where the sensor unit <NUM> does not detect an operation on the side surface (S1108: NO), the control unit <NUM> determines whether a certain period elapses after the preview image is displayed in Step S1105 (S1109). In a case where the certain period does not elapse (S1109: NO), the operation returns to Step S1106. On the one hand, in a case where the certain period elapses (S1109: YES), the control unit <NUM> hides the preview image (S1110), and the operation is ended.

Next, an example of a flow of a moving image photographing operation by the photographic application according to the present embodiment will be described. <FIG> is a view for describing an example of a flow of a moving image photographing operation by the photographic application according to the present embodiment.

Referring to <FIG>, it is determined whether the sensor unit <NUM> detects a trigger operation on the side surface of the information processing terminal <NUM> in a state in which the photographic application is active on the information processing terminal <NUM> (S1201). In a case where the sensor unit <NUM> does not detect the trigger operation (S1201: NO), the operation returns to Step S1201. In a case where the sensor unit <NUM> detects the trigger operation (S1201: YES), the control unit <NUM> causes the photographic application to stand by for a predetermined period (S1202). Then, a region to receive an operation by an operating finger is determined on the basis of a height on the display screen, the height corresponding to a detection position at which the trigger operation is executed and which is detected by the sensor unit <NUM> in Step S1201 (S1203).

Then, the control unit <NUM> causes the photographic application to start the moving image photographing processing (S1204). Then, the control unit <NUM> causes a controller to be displayed on the region determined in Step S1203 (S1205). Then, it is determined whether the sensor unit <NUM> detects an operation of ending the photographing by a predetermined operation on the side surface, an operation on a predetermined display region of the controller, or the like (S1206). In a case where the sensor unit <NUM> does not detect the operation of ending the photographing (S1206: NO), the operation returns to Step S1206. On the one hand, in a case where the sensor unit <NUM> detects the operation of ending the photographing (S1206: YES), the control unit <NUM> causes the photographic application to end the moving image photographing processing started in Step S1204 (S1207).

Then, the control unit <NUM> causes the region determined in Step S1203 to display a preview image of the moving image photographed by the photographic application in Step S1204 to Step S1207 (S1208). Then, the sensor unit <NUM> determines whether a subsequent operation is detected with respect to the preview image displayed on the display screen of the information processing terminal <NUM> (S1209). In a case where the sensor unit <NUM> detects the subsequent operation on the preview image (S1209: YES), the control unit <NUM> displays the moving image photographed between Step S1205 and Step S1207 on the display screen (S1210), and the operation is ended.

On the one hand, in a case where the sensor unit <NUM> does not detect the subsequent operation on the preview image (S1209: NO), it is determined whether an operation is detected on the side surface of the information processing terminal <NUM> (S1211). In a case where the operation on the side surface is detected by the sensor unit <NUM> (S1211: YES), the control unit <NUM> hides the preview image (S1213), and the operation is ended. On the one hand, in a case where the operation on the side surface is not detected (S1211: NO), the control unit <NUM> determines whether a certain period elapses since the preview image is displayed in Step S1105 (S1212). In a case where the certain period does not elapse (S1212: NO), the operation returns to Step S1209. On the one hand, in a case where the certain period elapses (S1212: YES), the control unit <NUM> hides the preview image (S1213), and the operation is ended.

Next, an example of a flow of an operation of determining a region to receive an operation according to the present embodiment will be described. <FIG> is a view for describing an example of a flow of an operation of limiting a region to receive an operation according to the present embodiment.

Referring to <FIG>, first, the sensor unit <NUM> detects a finger of a user on the side surface of the information processing terminal <NUM> (S1301). Then, it is determined whether the sensor unit <NUM> detects a trigger operation on the side surface in Step S1301 (S1302). In a case where the sensor unit <NUM> does not detect the trigger operation (S1302: NO), the operation returns to Step S1301. In a case where the sensor unit <NUM> detects the trigger operation (S1302: YES), the control unit <NUM> determines a height on the side surface which height corresponds to a detection position of the trigger operation (S1303). Then, the control unit <NUM> limits a region to receive an operation on the side surface on the basis of the height determined in Step S1303 and a position of a finger of the user (S1304). That is, an operable side surface is set.

Next, an example of a hardware configuration of the information processing terminal <NUM> according to an embodiment of the present disclosure will be described. <FIG> is a block diagram illustrating an example of a hardware configuration of an information processing terminal <NUM> according to an embodiment of the present disclosure. Referring to <FIG>, the information processing terminal <NUM> includes, for example, a processor <NUM>, a ROM <NUM>, a RAM <NUM>, a host bus <NUM>, a bridge <NUM>, an external bus <NUM>, an interface <NUM>, an input device <NUM>, an output device <NUM>, a storage <NUM>, a drive <NUM>, a connection port <NUM>, and a communication device <NUM>. Note that the hardware configuration described here is an example, and a part of the components may be omitted. Also, a component other than the components described here may be further included.

The processor <NUM> functions, for example, as an arithmetic processing device or a control device, and controls the overall operation of each component or a part thereof on the basis of various programs recorded in the ROM <NUM>, the RAM <NUM>, the storage <NUM>, or a removable recording medium <NUM>.

The ROM <NUM> is a means to store a program read by the processor <NUM>, data used for calculation, and the like. The RAM <NUM> temporarily or permanently stores, for example, a program read by the processor <NUM>, various parameters that appropriately change in execution of the program, and the like.

The processor <NUM>, ROM <NUM>, and RAM <NUM> are connected to each other, for example, via the host bus <NUM> capable of high-speed data transmission. On the one hand, the host bus <NUM> is connected to the external bus <NUM>, which has a relatively low data transmission rate, via the bridge <NUM>, for example. Also, the external bus <NUM> is connected to various components via the interface <NUM>.

As the input device <NUM>, for example, a mouse, a keyboard, a touch panel, a button, a switch, a lever, or the like is used. Furthermore, there is a case where a remote controller (hereinafter, remote controller) capable of transmitting a control signal by using infrared rays or other radio waves is used as the input device <NUM>. Also, the input device <NUM> includes a voice input device such as a microphone.

The output device <NUM> is a device that can visually or audibly notify a user of acquired information and is, for example, a display device such as a cathode ray tube (CRT), an LCD, or an organic EL, an audio output device such as a speaker or headphone, a printer, a mobile phone, a facsimile, or the like. Also, the output device <NUM> according to the present disclosure includes various vibration devices capable of outputting tactile stimulation.

The storage <NUM> is a device to store various kinds of data. As the storage <NUM>, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like is used.

The drive <NUM> is a device to read information recorded on the removable recording medium <NUM> such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, or to write information on the removable recording medium <NUM>.

The removable recording medium <NUM> is, for example, a DVD medium, a Blu-ray (registered trademark) medium, an HD DVD medium, various semiconductor storage media, or the like. Obviously, the removable recording medium <NUM> may be, for example, an IC card equipped with a non-contact type IC chip, an electronic device, or the like.

The connection port <NUM> is a port to connect an external connection device <NUM> and is, for example, a universal serial bus (USB) port, an IEEE <NUM> port, a small computer system interface (SCSI), an RS-232C port, an optical audio terminal, or the like.

The external connection device <NUM> is, for example, a printer, a portable music player, a digital camera, a digital video camera, an IC recorder, or the like.

The communication device <NUM> is a communication device for connection to a network and is, for example, a communication card for a wired or wireless LAN, Bluetooth (registered trademark), or a wireless USB (WUSB), a router for optical communication, a router for an asymmetric digital subscriber line (ADSL), a modem for various kinds of communication, or the like.

As described above, an information processing terminal <NUM> according to an embodiment of the present disclosure has a function of determining a region to receive an operation on a display screen and a side surface on the basis of a detection position of an operating finger on the side surface. With such a function, it becomes possible to reduce a burden of an operation related to a small terminal that includes a touch panel and that is used with one hand.

Preferred embodiments of the present disclosure have been described above in detail with reference to the accompanying drawings. However, the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in claims. Obviously, it is understood that these also belong to the technical scope of the present disclosure.

Claim 1:
An information processing device (<NUM>) comprising:
a sensor unit (<NUM>) configured to detect a contact of a finger of a user with the information processing device; and
a control unit (<NUM>) that is configured to determine, on the basis of a detection position of an operating finger of a user on a side surface of the information processing device with respect to a display screen (<NUM>) of the information processing device, a region to display predetermined information on the display screen, and that is configured to determine, on the basis of the detection position, a region to receive an operation by the operating finger from a region that is a combination of the display screen and the side surface; wherein
the control unit is configured to determine a region to display predetermined information on the display screen on the basis of the detection position of the operating finger executing a trigger operation on the side surface, and determine, on the basis of the detection position, a region (R1) to receive a subsequent operation by the operating finger from the region that is the combination of the display screen and the side surface; and
the control unit is configured to determine, on the basis of a positional relationship between a plurality of fingers of a user which relationship is detected by the sensor unit (<NUM>), the region (R1) to receive the subsequent operation and a region (R2) not to receive an operation by a finger of the user.