Patent Description:
The present disclosure relates to an information processing apparatus, an information processing method, and a program.

PTL <NUM> discloses an imaging device that, when a user selects any one of a plurality of icons, displays a submenu associated with the selected icon.

"<NPL> <CIT> relates to the coordination of display of on-screen elements including a graphical wallpaper representation.

<CIT> considers a digital camera i.e. professional mirror reflex camera that has control elements arranged at a housing, where functions of applications are activated with selection elements and adjusted with an adjustment element. <CIT> relates to an image pickup control apparatus, method, system and storage medium.

<CIT> describes management of user interface elements in a display environment.

<CIT> relates to an image pickup device and image pickup method.

<CIT> relates to an electronic device that enables user-friendly operations for selecting one or more customized items from among multiple settings items.

In this technology, however, when the user attempts to change a shooting parameter, it is necessary for the user to first select an icon corresponding to the shooting parameter that the user attempts to change. For this reason, if the user do not know an icon corresponding to the shooting parameter, it is necessary for the user to select icons one by one and to find out a desired shooting parameter from a submenu. Thus, it takes a lot of effort to set a shooting parameter.

Therefore, it is desirable to provide a technology that allows a user to easily set a shooting parameter.

The invention is set out in the attached claims.

The processor may receive a selection of an imaging mode, and in controlling the display of the plurality of parameter-setting display layers, determine which ones of the collection of parameter-setting-widgets to allocate to which of the plurality of parameter-setting display layers based on the selected imaging mode.

The processor may, in determining which ones of the collection of parameter-setting-widgets to allocate to which of the plurality of parameter-setting display layers, assign a priority to each of the parameter-setting-widgets based on the selected imaging mode, where the parameter-setting-widgets are allocated to the plurality of parameter-setting display layers in accordance with the assigned priorities.

The processor may control display of an imaging-mode-setting widget that enables the user to select the imaging mode.

The processor may, in response to receiving a predetermined user input, superimpose the imaging-mode-setting widget over a currently selected parameter-setting display layer.

The processor may control display of a widget-arrangement interface that enables the user to allocate the collection of parameter-setting-widgets among the plurality of parameter-setting display layers for the selected imaging mode; and receive user input via the widget-allocation interface allocating at least a given one of the parameter-setting-widgets to a given one of the plurality of parameter-setting display layers, wherein the determining of which parameter-setting-widgets to allocate to which of the plurality of parameter-setting display layers is further based on the received user input allocating the given parameter-setting-widget. The controlling of the display of the widget-arrangement interface may include generating a graphical representation of at least one of the plurality of layers in a first display region and a graphical representation of at least one of the parameter-setting-widget images in a second display region, wherein the user allocates the given parameter-setting-widget to the given parameter-setting display layer by dragging the graphical representation of the given parameter-setting-widget in the widget-arrangement interface onto the graphical representation of the given parameter-setting display layer.

The processor may, in response to the user selecting the graphical representation of the given parameter-setting-widget in the widget-arrangement interface, identifying another one of the parameter-setting-widgets that is relevant to the given parameter-setting-widget.

The processor may visually highlight in the widget-arrangement interface the identified parameter-setting-widget that is relevant to the given parameter-setting-widget.

The processor may, in response to a user input that associates the graphical representation of the given parameter-setting-widget in the widget-arrangement interface with the graphical representation of the given parameter-setting display layer, automatically associate the graphical representation of the identified parameter-setting-widget that is relevant to the given parameter-setting-widget with the graphical representation of the given parameter-setting display layer.

The allocation of the plurality of parameter-setting-widgets among the plurality of parameter-setting display layers may depend upon an imaging mode that is selected.

The processor may control display of an image-for-display by superimposing over a captured image the parameter-setting-widgets allocated to a selected layer of the plurality of parameter-setting display layers.

The processor may switch the one of the plurality of layers that is the selected layer based on a user input.

The electronic apparatus may further include an image sensor. The processor may control display of an image-for-display by superimposing, over a through-the-lens-image captured by the image sensor, the parameter-setting-widgets allocated to a selected layer of the plurality of parameter-setting display layers.

The electronic apparatus may further include a display unit that displays an image-for-display generated by the processor.

According to one or more of embodiments of the present disclosure as described above, the user can easily set a shooting parameter. Note that advantages of the technology according to the present disclosure are not limited to those described herein. The technology according to the present disclosure may have any technical advantage described herein and other technical advantages that are apparent from the present specification.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the appended drawings.

The description will be made in the following order.

An information processing apparatus <NUM> according to the first embodiment generally generates a plurality of layers in which a widget image for setting a shooting parameter related to imaging (shooting parameter setting image) are arranged. Specifically, the information processing apparatus <NUM> determines a widget image to be arranged in each layer based on a shooting mode. The information processing apparatus <NUM> then arranges a widget image to each layer. On the other hand, the information processing apparatus <NUM> captures an image and generates a through-the-lens image. The information processing apparatus <NUM> then sets any one layer as a display layer and superimposes the display layer on the through-the-lens image for displaying on a display unit. One or a plurality of widget images are arranged (displayed) in the display layer.

A widget image according to an embodiment of the present disclosure includes an image for setting a shooting parameter, more specifically, an image capable of performing an input operation for setting a shooting parameter. A shooting parameter is a parameter related to imaging and is not limited to a particular type. A shooting parameter includes, for example, shutter speed (Tv), aperture value (Av), ISO value, shooting mode, focus, dynamic range, panorama, angle-of-view correction, hue correction, exposure compensation, various edit information, and image quality correction (for example, skin smoothing). The shooting mode includes an exposure mode. The widget image may have the position to be displayed and size that can be optionally changed by the user's operation. In addition, the widget image may include an image for indicating the current shooting parameter (for example, widget image <NUM> or <NUM>, which will be described later).

The information processing apparatus <NUM> includes an operation unit <NUM> including, for example, a touch panel <NUM> and performs processes corresponding to various input operations performed by a user using the operation unit <NUM>. For example, the information processing apparatus <NUM> adjusts a shooting parameter based on a shooting parameter setting operation (for example, an operation of tapping a predetermined position on a widget image) of the user. Furthermore, the information processing apparatus <NUM> moves a widget image based on a widget image moving operation (for example, drag operation) of the user. Moreover, the information processing apparatus <NUM> zooms in and out a widget image based on a widget image zooming operation (for example, pinch-out or pinch-in operation) of the user.

The information processing apparatus <NUM> also switches a display layer based on a display layer switching operation (for example, horizontal flick operation) of the user. The information processing apparatus <NUM> also changes a shooting mode based on a shooting mode setting operation (for example, vertical flick operation) of the user. The information processing apparatus <NUM> then determines a widget image to be arranged in each layer based on a shooting mode.

The information processing apparatus <NUM> also arranges a widget image selected by a setting image selection operation (for example, an operation of dragging a widget icon into a layer frame image, which will be described later) of the user in each layer.

In this way, the user can select a widget image to be arranged in each layer as desired and can adjust optionally the arrangement position and size of each widget image. In other words, the user can customize each layer as desired. In addition, the user can adjust a shooting parameter by simply performing a shooting parameter setting operation using a widget image displayed on each layer. Thus, according to the first embodiment, the user is able to set a shooting parameter easily.

The configuration of the information processing apparatus <NUM> according to the present embodiment is now described with reference to <FIG>.

As shown in <FIG>, the information processing apparatus <NUM> is configured to include a storage unit <NUM>, a communication unit <NUM>, an imaging unit <NUM>, a display unit <NUM>, an operation unit (input operation unit) <NUM>, and a control unit <NUM>. The storage unit <NUM> stores a program which causes the information processing apparatus <NUM> to execute functions of the storage unit <NUM>, the communication unit <NUM>, the imaging unit <NUM>, the display unit <NUM>, the operation unit <NUM>, and the control unit <NUM>. The storage unit <NUM> also stores various types of image information (for example, various widget images).

The communication unit <NUM> communicates with another information processing apparatus. The imaging unit <NUM> captures an image. Specifically, the imaging unit <NUM> outputs an image captured by an image sensor to the control unit <NUM> as a through-the-lens image until the user performs a shooting operation (for example, an operation of depressing a shutter button which is not shown). The shutter button may be a hard key or may be a button displayed on the display unit <NUM>. When the user performs a shooting operation, the imaging unit <NUM> captures an image (specifically, performs an action such as releasing a shutter) depending on a setting value of Tv/Av and ISO values. Then, the imaging unit <NUM> outputs the image captured by the image sensor to the control unit <NUM> as a captured image.

The display unit <NUM> displays various images, for example, a widget image and a through-the-lens image as described above. The operation unit <NUM> may be a touch panel and is disposed on a surface of the display unit <NUM>. The operation unit <NUM> allows the user to perform various input operations, for example, a shooting parameter setting operation. The operation unit <NUM> outputs operation information related to an input operation performed by the user to the control unit <NUM>. The control unit <NUM> controls the entire information processing apparatus <NUM> and, in particular, receives an input operation and performs various processes. In addition, the control unit <NUM> performs, for example, a process of arranging a widget image in each layer and performs control of displaying any of layers as a display layer.

The information processing apparatus <NUM> has the hardware configuration shown in <FIG>, and such hardware configuration allows the storage unit <NUM>, the communication unit <NUM>, the imaging unit <NUM>, the display unit <NUM>, the operation unit <NUM>, and the control unit <NUM> to be executed.

In other words, the information processing apparatus <NUM> is configured to include a non-volatile memory <NUM>, a RAM <NUM>, a communication device <NUM>, an imaging device <NUM>, a display <NUM>, a touch panel <NUM>, and a CPU <NUM>, as its hardware configuration.

The non-volatile memory <NUM> stores, for example, various programs and image information. The program stored in the non-volatile memory includes a program which causes the information processing apparatus <NUM> to execute functions of the storage unit <NUM>, the communication unit <NUM>, the imaging unit <NUM>, the display unit <NUM>, the operation unit <NUM>, and the control unit <NUM>.

The RAM <NUM> is used as a work area of the CPU <NUM>. The communication device <NUM> communicates with another information processing apparatus. The imaging device <NUM> captures an image and generates a captured image. The display <NUM> displays various types of image information. The display <NUM> may output audio information. The touch panel <NUM> accepts various input operations of the user.

The CPU <NUM> reads out and executes the program stored in the non-volatile memory <NUM>. Thus, the CPU <NUM>, which reads out and executes the program stored in the non-volatile memory <NUM>, allows the information processing apparatus <NUM> to execute functions of the storage unit <NUM>, the communication unit <NUM>, the imaging unit <NUM>, the display unit <NUM>, the operation unit <NUM>, and the control unit <NUM>. In other words, the CPU <NUM> functions as a component for practically operating the information processing apparatus <NUM>.

The information processing apparatus <NUM> may be a smartphone, smart tablet, or other smart device, but is not particularly limited as long as it satisfies the above requirements. For example, the information processing apparatus <NUM> may be an imaging device that has the above configuration. However, a smartphone or smart tablet is more preferable because it often has a display screen larger in size than that of the imaging device. In addition, a specific example of the operation unit <NUM> is a touch panel, but other operation devices may be employed. In other words, the operation unit <NUM> is not particularly limited as long as it can perform various input operations described above, and may be a hard key such as a cross key and a dial. In addition, the hard key and the touch panel may be used in combination with each other. For example, a sophisticated operation may be performed with a hard key. However, it is preferable to use a touch panel as a specific example of the operation unit <NUM>. In particular, when the information processing apparatus <NUM> is a smartphone, smart table, or other smart device, it is preferable to use a touch panel as a specific example of the operation unit <NUM>. This is because the user of a smartphone, smart table, or other smart device may be likely to feel it is difficult to operate a hard key. In addition, if an operation is performed in combination with a hard key, it is necessary for the user to capture an image while checking the hard key, and thus the shooting operation may be interrupted. For example, it may be necessary for the user to check separately the operation of a hard key and the display of the display unit <NUM>.

The basic process procedure of the information processing apparatus <NUM> is now described with reference to the flow chart shown in <FIG>.

In step S10, the information processing apparatus <NUM> creates a plurality of layers (a group of layers) based on the current shooting mode. Specifically, the control unit <NUM> determines (selects) a widget image to be arranged in each layer based on the current shooting mode. In other words, the purpose of the user to capture an image is different for each shooting mode. For example, when a shooting mode is set to a shutter speed priority mode, the user is more likely to capture an image using a high-speed shutter. In addition, when a shooting mode is set to an aperture priority mode, the user is more likely to capture an image in which portions other than a subject are blurred. Thus, the control unit <NUM> selects a widget image corresponding to (suitable for) the purpose of shooting that is to be performed by the user.

The shooting mode is not particularly limited. The shooting mode includes, for example, various exposure modes, a panorama mode, various scene modes, an edit mode, a preview mode, a playback mode, and a recording (REC) mode. The exposure mode includes, for example, an auto mode, a manual mode, an aperture priority mode, and a shutter speed priority mode. In addition, the scene mode includes, for example, sports, night, macro, landscape, night portrait, and sunset.

When the current shooting mode is set to a program mode, the control unit <NUM> selects a widget image for setting, for example, exposure (Tv/Av), ISO, scene mode, drive mode (particularly, a self-timer), and picture effect, as a widget image.

When the current shooting mode is set to an aperture priority mode, the control unit <NUM> selects a widget image for setting creative style, beauty effect, manual focus, focus magnification, and a level, as a widget image.

When the current shooting mode is set to a shutter speed priority mode, the control unit <NUM> selects a widget image for setting, for example, a drive mode (particularly, a continuous shooting mode), auto focus (AF-C/AF-D), tracking focus, bracket shooting, and ISO, as a widget image.

When the current shooting mode is set to a manual mode, the control unit <NUM> selects a widget image for setting, for example, ISO, white balance, dynamic range, and image quality, as a widget image.

When the current shooting mode is set to an auto mode, the control unit <NUM> may select a shooting scene by a process described later and may select a widget image based on the shooting scene. Note that these are only illustrative and other widget images may be selected for every scene.

The control unit <NUM> then generates a plurality of layers. The number of layers may be one, but preferably two or more. The control unit <NUM> assigns a layer number (for example, an integer of <NUM> or more) to each layer and arranges a widget image in each layer. Hereinafter, a layer assigned with a layer number "n" (n is an integer of <NUM> or more) is also referred to as "nth layer".

The control unit <NUM> may set a priority for each widget image based on a shooting mode and may arrange a widget image having a high priority in a layer having a low number. For example, when the current shooting mode is set to a program mode, the control unit <NUM> may arrange a widget image for setting exposure and ISO of the widget images described above in the first layer and may arrange other widget images to the second and subsequent layers. In addition, the arrangement of a widget image in each layer is not particularly limited. The control unit <NUM> may determine the priority based on other parameters, for example, frequency in use of a widget image by the user. For example, the control unit <NUM> monitors the frequency in use of a widget image for every shooting mode. When any one shooting mode is selected, the control unit <NUM> may determine the priority of each widget image based on the frequency in use that corresponds to the selected shooting mode. For example, the control unit <NUM> may set the priority to be higher as the frequency in use by the user increases.

In step S20, the imaging unit <NUM> captures an image and outputs a captured image obtained by capturing to the control unit <NUM>. The control unit <NUM> causes the display unit <NUM> to display the captured image as a through-the-lens image. The control unit <NUM> also sets any one layer (first layer for an initial state) of layers as a display layer and superimposes the display layer on the through-the-lens image for displaying. The control unit <NUM> also displays a display layer indicator that indicates a layer number of the current display layer.

When an input operation for a widget image is performed, the control unit <NUM> sets a shooting parameter corresponding to the input operation. The control unit <NUM> may cause only the widget image which is being operated by the user from among widget images in the display layer to be displayed. The control unit <NUM> may cause the widget image which is being operated by the user to be displayed in an enlarged manner.

When the user performs a display layer switching operation, the control unit <NUM> switches the display layer. For example, when the user performs a right flick operation (a finger flick operation in the right direction in <FIG>), the control unit <NUM> sets a layer having the layer number higher by one than that of the current display layer as the display layer. When the user performs a left flick operation (a finger flick operation in the left direction in <FIG>), the control unit <NUM> sets a layer having the layer number lower by one than that of the current display layer as the display layer.

The control unit <NUM> may change a way of performing the display layer switching operation depending on the current shooting mode. For example, when the shooting mode is set to a mode of displaying a through-the-lens image, the control unit <NUM> may set a horizontal flick operation as the display layer switching operation. In addition, when the shooting mode is set to the edit mode of a captured image, the control unit <NUM> may set a horizontal flick operation as the display layer switching operation. In addition, when the shooting mode is set to the playback mode of a captured image, the control unit <NUM> may set a vertical flick operation (a finger flick operation in the vertical direction in <FIG>) as the display layer switching operation. When the horizontal flick operation is performed, the control unit <NUM> switches the captured image being displayed.

In other words, the control unit <NUM> may specify the display layer switching operation so that the input operation during the shooting mode and the display layer switching operation are not overlapped. In addition, the control unit <NUM> may switch the display of a widget image on and off, depending on a shooting mode. For example, when the shooting mode is set to the preview mode, the control unit <NUM> may delete a widget image. When the shooting mode is set to the recording mode, the control unit <NUM> may cause only a widget image suitable for the recording mode (for example, a widget image for performing brightness adjustment, backlight correction, or the like) to be displayed, but may delete the widget image. Then, the control unit <NUM> ends the process.

As described above, the control unit <NUM> selects a widget image corresponding to the current shooting mode and arranges the selected widget images in each layer. However, the control unit <NUM> may arrange a preset widget image in each layer regardless of a shooting mode. The control unit <NUM> changes a display layer based on the display layer switching operation, but control unit <NUM> may allow a display layer to be switched automatically.

Accordingly, the information processing apparatus <NUM> allocates a widget image to a plurality of layers, and thus it is possible to obtain a larger area for displaying a widget image. In other words, the information processing apparatus <NUM> may eliminate the need to narrow intervals between widget images (that is, to achieve space saving) for displaying. Thus, the information processing apparatus <NUM> can improve the ability to browse through widget images (that is, to make the widget images more visually intelligible).

The user also can set a shooting parameter directly by an operation (for example, a tap operation) on a widget image, and thus an operation necessary for setting a shooting parameter can be simplified (steps can be saved).

The user can arrange a desired widget image in a desired layer. The user can display a desired widget image by switching a display layer and can set a shooting parameter using the displayed widget image. Thus, the user can easily set a shooting parameter. In particular, if the information processing apparatus <NUM> is a smartphone, smart tablet, or other smart device, the usability of camera functions is improved. As a result, the camera functions are easy for so-called high-end users to understand, and the shooting experience can be expected to be more familiar. Thus, the group of users having a smartphone, smart tablet, or other smart device is expected to expand further.

Some of examples of layer display are now described. Note that the following description is only an exemplary layer and other widget images may be arranged in each layer. <FIG> illustrates an example of displaying a first layer. The control unit <NUM> displays a through-the-lens image <NUM>, display layer indicators 210a to 210e, and widget images <NUM>, <NUM>, <NUM>, <NUM>, and <NUM>. In other words, the control unit <NUM> arranges the widget images <NUM> to <NUM> in the first layer.

The display layer indicators 210a to 210e are indicators that represent the layer number of a display layer, and the indicators 210a to 210e correspond to the layer numbers <NUM> to <NUM>, respectively. The control unit <NUM> highlights the display layer indicator 210a that corresponds to a display layer. In other words, the control unit <NUM> displays the display layer indicator 210a in a manner different from other indicators 210b to 210e (for example, with different color or luminance). When the display layer switching operation is performed, the control unit <NUM> switches a display layer and highlights an indicator corresponding to the current display layer.

The widget image <NUM> is a dial image that is used to set (select) a shooting mode. Specifically, the widget image <NUM> has a plurality of shooting mode symbols <NUM>, which indicate a shooting mode, marked in the circumferential direction, and a shooting mode symbol <NUM> at the left end of these shooting mode symbols <NUM> is highlighted. The shooting mode symbol <NUM> indicates a shooting mode being currently set. In other words, the control unit <NUM> rotates the dial image <NUM> depending on the user's input operation and highlights the shooting mode symbol <NUM> shown at the left end of the dial image <NUM>. The control unit <NUM> then sets the current shooting mode as a shooting mode indicated by the shooting mode symbol <NUM>. The input operation for rotating the dial image <NUM> may be performed, for example, by tapping the dial image <NUM> with the finger, and in this state, by moving the finger in the circumferential direction. In the example of <FIG>, a manual mode (M) is selected. The widget images corresponding to the manual mode are arranged in the first to fifth layers.

The widget image <NUM> is an image that is used to set (select) a focus mode. A plurality of focus mode symbols <NUM> are marked in the widget image <NUM>, and a focus mode symbol <NUM> of these focus mode symbols <NUM> is highlighted. The focus mode symbol <NUM> indicates a focus mode that is being currently selected. For example, when the user taps any one of the focus mode symbols <NUM>, the control unit <NUM> highlights the focus mode symbol <NUM> tapped by the user and shifts to a focus mode corresponding to the focus mode symbol <NUM>. The widget image <NUM> indicates a shooting parameter (for example, Tv/AV or ISO value) that is being currently set.

The widget image <NUM> is a widget image in which the horizontal axis <NUM> represents Tv and the vertical axis <NUM> represents Av. When the user taps any one point on the widget image <NUM>, the control unit <NUM> displays a point P1 on the tapped point. The control unit <NUM> also sets a Tv/AV value as the Tv/AV value indicated by the point P1, and highlights the Tv/AV value indicated by the point P1 on the horizontal axis <NUM> and the vertical axis <NUM>. In the example of <FIG>, the Tv value is set to <NUM>/<NUM> and the Av value is set to <NUM>. The current shooting mode is set to the manual mode, and thus the control unit <NUM> provides no limitation on the Tv/Av value. Thus, the user can select (set) the Tv/Av value by tapping any one point on the widget image <NUM>.

Furthermore, the control unit <NUM> displays a reference line <NUM> passing through the point P1 on the widget image <NUM>. The Tv/Av value indicated by each point on the reference line <NUM> indicates the same amount of exposure as that of the point P1. The reference line <NUM> is extended to the outside through the right upper end of the widget image <NUM>.

If the user taps a point other than the point P1 during display of the point P1, then the control unit <NUM> moves the point P1 to the point tapped by the user. Then, the control unit <NUM> sets the Tv/Av value to a Tv/Av value indicated by the point P1 after movement. Furthermore, the control unit <NUM> causes the reference line <NUM> to follow the point P1 newly set.

Note that a way for the user to select (set) the Tv/Av value is not limited to the way of tapping a point on a widget image, and is not particularly limited as long as a point on the widget image <NUM> can be selected. For example, the user may select a point on the widget image <NUM> using a drag-and-drop operation. For example, when the user drags the point P1, the control unit <NUM> causes the point P1 to follow the finger of the user, and when the user drops the point P1, the control unit <NUM> displays the point P1 at the position. The control unit <NUM> may accept the operation of combination between the tap operation and the drag-and-drop operation. Then, the control unit <NUM> may set the Tv/Av value to a Tv/Av value indicated by the moved point P1.

The widget image <NUM> is a bar image used to select an ISO value. In the widget image <NUM>, each point in the longitudinal direction indicates an ISO value, a point <NUM> at the upper end indicates the maximum value of the ISO values, and a point <NUM> at the lower end indicates the minimum value of the ISO values. In the example of <FIG>, the maximum value is set to <NUM> and the minimum value is set to <NUM>, but the maximum and minimum values are not limited to these examples. The control unit <NUM> displays a maximum value display image 410a near the point <NUM> at the upper end of the widget image <NUM> and displays a minimum value display image 420a near the point <NUM> at the lower end of the widget image <NUM>.

The control unit <NUM> displays the widget image <NUM> in association with the widget image <NUM>. Specifically, the control unit <NUM> displays the widget image <NUM> in a position intersecting with the reference line <NUM>. More specifically, the control unit <NUM> sets the ISO value indicated by a point P2 at which the widget image <NUM> and the reference line <NUM> intersect as a setting value of the ISO value. In other words, the control unit <NUM> causes the point P2 in the widget image <NUM> corresponding to the setting value of the ISO value to be intersected with the reference line <NUM>. In addition, the control unit <NUM> displays a setting value display image <NUM> indicating the setting value of the ISO value in the vicinity of the point P2.

Moreover, the control unit <NUM> moves the widget image <NUM> in the direction of an arrow 400a or 400b depending on the user's input operation. The input operation includes, for example, a way of tapping the widget image <NUM> with the finger and dragging the finger to the direction of the arrow 400a or 400b. This also changes the setting value indicated by the point P2, and thus the control unit <NUM> sets (changes) the ISO value as a setting value indicated by the point P2.

The control unit <NUM> causes the widget image <NUM> to follow the reference line <NUM> when the reference line <NUM> is moved. In this time, the control unit <NUM> may maintain the ISO value to be the current value, and may change the ISO value to the optimal value (or a preset initial value) that corresponds to the changed Tv/Av value. The "optimal value" in an embodiment of the present disclosure refers to a value that is determined as being optimal by the control unit <NUM>. In the former case, the control unit <NUM> adjusts the position of the widget image <NUM> to maintain the ISO value. In other words, the position of the point P2 in the widget image <NUM> before and after movement of the reference line <NUM> remains unchanged. In the latter case, the control unit <NUM> calculates an optimal value of the ISO value corresponding to the Tv/Av value and sets the ISO value as the optimal value (or sets the ISO value as the preset initial value). Moreover, the control unit <NUM> adjusts the position of the widget image <NUM> so that the point P2 indicates an optimal value (or initial value).

The control unit <NUM> calculates an optimal value of the Tv/Av value and ISO value and adjusts the positions of the point P1, the reference line <NUM>, and the widget image <NUM> based on the calculated optimal value, in the initial state, that is, in the state where the images shown in <FIG> begin to be displayed.

A setting image used to set the ISO value (a second setting image) is not limited to the bar image. For example, the second setting image may be a dial-shaped image. Such a dial image has an ISO value marked in the circumferential direction thereof as in the dial image <NUM>. The control unit <NUM> causes any one of ISO values on the dial image to be intersected with the reference line <NUM>. The control unit <NUM> sets the ISO value intersected with the reference line <NUM> as a setting value.

The control unit <NUM> also may cause the through-the-lens image <NUM> to be changed depending on the current shooting parameter (for example, Tv/Av value and ISO value). For example, the control unit <NUM> may perform a process such as blurring and panning on the through-the-lens image <NUM> depending on the current Tv/Av value and ISO value. In this case, the user can easily grasp how the through-the-lens image <NUM> changes depending on the current shooting parameter.

The control unit <NUM> also may reset the setting value of the Tv/Av value and ISO value for every shooting operation, or may remain the setting value unchanged.

When the shooting mode is set to the auto mode (the mode in which Tv/Av value and ISO value are set automatically), the control unit <NUM> also may perform the following processes. In other words, each time when the user performs a preliminary operation of the shooting operation (for example, operation of depressing a shooting button halfway), the control unit <NUM> may calculate an optimal value of the Tv/Av value and ISO value and may adjust dynamically the positions of the point P1, the reference line <NUM>, and the widget image <NUM> based on the calculated optimal value. This makes it possible for the user to grasp easily, for example, how the Tv/Av value and ISO value are changed for every shooting scene. Thus, for example, novice users or advanced amateur users can know the mechanism of an imaging device using a graphical representation. Accordingly, novice users and advanced amateur users are interested in the Tv/Av value and ISO value, and eventually, it is expected that they become more motivated to change these shooting parameters by their own desire.

According to the first display example, the display unit <NUM> displays the widget images <NUM> and <NUM> in association with each other, and thus the user can grasp intuitively the relevance between these shooting parameters. Accordingly, the user can set intuitively these shooting parameters. The user may set the Tv/Av value before ISO value, or may set the ISO value before Tv/Av value.

Furthermore, the user can set the Tv/Av value and ISO value using only two steps, the step of tapping (or drags and drops) the widget image <NUM> and the step of moving the widget image <NUM>. Thus, the user can set easily these shooting parameters. Moreover, the control unit <NUM> changes the widget images <NUM> and <NUM> depending on the user's operation (for example, to move the point P1 and the reference line <NUM>, and to move the widget image <NUM>). Thus, the user can set these shooting parameters in a graphical and dynamical (flexible) manner.

A veteran user can view each of shooting parameters with his eyes and comprehend it before shooting. A novice user can easily grasp how each shooting parameter changes depending on his input operation. Accordingly, it is expected that a novice user becomes much more interested in setting of each shooting parameter.

Furthermore, the information processing apparatus <NUM> can provide an interface that allows the user of the existing imaging device to perform an input operation more efficiently. On the other hand, the information processing apparatus <NUM> allows the user who feels any difficulty in using an imaging device like users of a smartphone, smart tablet, or other smart device to be more accessible. In addition, the applicability of display modes in the information processing apparatus <NUM> to the imaging device makes it possible to diversify the product form of the imaging device and meet the needs of an increasing number of users.

The inventors have also contemplated a technology that sets each shooting parameter with only a hard key (for example, any combination of dial, button, cross key, or the like). However, in this technology, setting of one shooting parameter may often necessitate a multi-step process. In addition, it is also difficult for the user to know the relevance between shooting parameters. The usability depends on the number and installation position of hard keys. If the number of hard keys is small, combinations of these hard keys are increased, resulting in the more complicated operations. In addition, in the technology disclosed in PTL <NUM>, there are many cases where the shooting parameter is incapable of being set with only one submenu. In this case, the user will set the shooting parameter by following a plurality of submenus (submenu having a deep hierarchy), so the operation will be complicated.

The second display example is now described with reference to <FIG>. In the second display example, the control unit <NUM> arranges widget images <NUM> and <NUM> in the third layer and sets the third layer as a display layer. In addition, the control unit <NUM> highlights the display layer indicator 210c.

The widget image <NUM> is an image used to set (adjust) dynamic range and includes a gauge image 900a and an arrow image 900b. The gauge image 900a is a strip-shaped image in which a scale is formed in the longitudinal direction. Each scale indicates the value of dynamic range. The arrow image 900b indicates any scale in the gauge image 900a. The control unit <NUM> moves the arrow image 900b in the left and right direction depending on the user's input operation. In this case, the input operation includes, for example, an operation of dragging and dropping the arrow image 900b and an operation of tapping a desired point on the gauge image 900a. Then, the control unit <NUM> changes a setting value of dynamic range to the dynamic range indicated by the arrow image 900b. The widget image <NUM> is a histogram in which the horizontal axis represents luminance of pixel and the vertical axis represents frequency (the number of pixels).

The third display example is now described with reference to <FIG>. In the third display example, the control unit <NUM> arranges widget images <NUM> and <NUM> in the fourth layer, and sets the fourth layer as a display layer. In addition, the control unit <NUM> highlights the display layer indicator 210d.

The widget image <NUM> is an image used to set (adjust) the hue of a captured image and includes a gauge image 920a. The gauge image 920a is a strip-shaped image in which a scale is formed in the longitudinal direction. Each scale indicates a value of hue. In the gauge image 920a, hue is displayed as gradation of color.

The control unit <NUM> sets a hue depending on the user's input operation. In this case, the input operation includes, for example, an operation of tapping a desired point on the gauge image 920a. The control unit <NUM> may display an arrow image indicating any one scale in the gauge image 920a near the gauge image 920a and may move the arrow image depending on the user's input operation. Then, the control unit <NUM> may set the hue indicated by the arrow image as the current hue.

The widget image <NUM> is an image used to set (adjust) the amount of exposure compensation (the amount of brightness correction) of a captured image, and includes a gauge image 930a. The gauge image 930a is a strip-shaped image in which a scale is formed in the longitudinal direction. Each scale indicates a value of the amount of exposure compensation. In addition, in the gauge image 930a, the amount of exposure compensation is displayed as a gradation representation. In other words, as the scale has a larger amount of exposure compensation, it is displayed as higher luminance.

The control unit <NUM> sets the amount of exposure compensation depending on the user's input operation. In this case, the input operation includes, for example, an operation of tapping a desired point on the gauge image 930a. The control unit <NUM> may display an arrow image indicating any one scale in the gauge image 930a near the gauge image 930a and may move the arrow image depending on the user's input operation. Then, the control unit <NUM> may set the amount of exposure compensation indicated by the arrow image as the current amount of exposure compensation.

The fourth display example is now described with reference to <FIG>. In the fourth display example, the control unit <NUM> arranges widget images <NUM> and <NUM> in the fifth layer, and sets the fifth layer as a display layer. In addition, the control unit <NUM> highlights the display layer indicator 210e.

The widget image <NUM> is an image used to set (select) an image style (representation style) of a captured image. The image style indicates any combination of saturation, brightness, and contrast. The widget image <NUM> includes a plurality of image style icons 940a to 940f. In each of the image style icons 940a to 940f, a sample image in which an image style is applied to a through-the-lens image is drawn. The control unit <NUM> sets an image style depending on the user's input operation. In this case, the input operation includes, for example, an operation of tapping any one of the image style icons 940a to 940f.

The widget image <NUM> is an image used to set (select) the color of a portion of a captured image. The widget image <NUM> includes a plurality of color setting icons 950a to 950d. In each of the color setting icons 950a to 950d, a sample image in which a portion of the through-the-lens image is colored is drawn.

The control unit <NUM> sets the color depending on the user's input operation. In this case, the input operation includes, for example, an operation of tapping any one of the color setting icons 950a to 950d.

The shooting mode switching according to the invention is now described with reference to <FIG>. That is, when the user performs a shooting mode setting operation (for example, a vertical flick operation), the control unit <NUM> displays a shooting mode setting image <NUM>-<NUM> as shown in <FIG>.

The shooting mode setting image <NUM>-<NUM> is a dial image with a semi-circular shape that is used to set (select) a shooting mode and has a similar function as that of the widget image <NUM>. In other words, in the shooting mode setting image <NUM>-<NUM>, a plurality of shooting mode symbols <NUM> that indicate a shooting mode are marked in the circumferential direction, and a shooting mode symbol <NUM> at the right end of these shooting mode symbols <NUM> is highlighted. The shooting mode symbol <NUM> indicates a shooting mode that is currently set.

Then, the control unit <NUM> rotates the shooting mode setting image <NUM>-<NUM> depending on the shooting mode setting operation. For example, when the shooting mode setting operation is an upward flick operation, the control unit <NUM> rotates the shooting mode setting image <NUM>-<NUM> in the counterclockwise direction. On the other hand, when the shooting mode setting operation is a downward flick operation, the control unit <NUM> rotates the shooting mode setting image <NUM>-<NUM> in the clockwise direction.

Then, the control unit <NUM> highlights a shooting mode symbol <NUM> marked at the right end of the shooting mode setting image <NUM>-<NUM>. Then, the control unit <NUM> sets the current shooting mode as a shooting mode indicated by the shooting mode symbol <NUM>. In the example of <FIG>, the shutter speed priority mode (S) is selected. Thereafter, the control unit <NUM> deletes the shooting mode setting image <NUM>-<NUM>. Then, the control unit <NUM> selects a widget image corresponding to the shutter speed priority mode (S) that is the current shooting mode, and arranges the selected widget image in each layer. A specific way of arrangement is the same as described above.

Although the dial image <NUM> is omitted in the example of <FIG>, the control unit <NUM> may display the dial image <NUM> together with the shooting mode setting image <NUM>-<NUM>. In this case, the control unit <NUM> may rotate the dial image <NUM> in synchronization with the shooting mode setting image <NUM>-<NUM>. The shooting mode symbol <NUM> of the dial image <NUM> and the shooting mode symbol <NUM> of the shooting mode setting image <NUM>-<NUM> indicate the same shooting mode.

When the current shooting mode is set to the shutter speed priority mode and the user performs a downward flick operation, the control unit <NUM> rotates the shooting mode setting image <NUM>-<NUM> in the clockwise direction as shown in <FIG>. Then, the control unit <NUM> highlights the shooting mode symbol <NUM> that indicates an aperture priority mode (A). Then, the control unit <NUM> set the current shooting mode as the aperture priority mode. Thereafter, the control unit <NUM> deletes the shooting mode setting image <NUM>-<NUM>. The control unit <NUM> then selects a widget image corresponding to the aperture priority mode that is the current shooting mode, and arranges the selected widget image in each layer.

When the current shooting mode is set to the aperture priority mode and the user performs a downward flick operation, the control unit <NUM> rotates the shooting mode setting image <NUM>-<NUM> in the clockwise direction as shown in <FIG>. Then, the control unit <NUM> highlights the shooting mode symbol <NUM> that indicates a program mode (P). Then, the control unit <NUM> set the current shooting mode as the program mode. Thereafter, the control unit <NUM> deletes the shooting mode setting image <NUM>-<NUM>. The control unit <NUM> then selects a widget image corresponding to the program mode that is the current shooting mode, and arranges the selected widget image in each layer.

The shooting mode setting image is not limited to the above example. An example of another shooting mode setting mode according to the invention is now described. <FIG> illustrates a shooting mode setting image <NUM>-<NUM> as another example of the shooting mode setting image. The shooting mode setting image <NUM>-<NUM> is a circular dial image that is similar to the widget image <NUM>. In the shooting mode setting image <NUM>-<NUM>, a plurality of shooting mode symbols <NUM> that indicate a shooting mode are marked in the circumferential direction, and a shooting mode symbol <NUM> at the right end of these shooting mode symbols <NUM> is highlighted. The shooting mode symbol <NUM> indicates a shooting mode that is currently set.

The control unit <NUM> rotates the shooting mode setting image <NUM>-<NUM> depending on the shooting mode setting operation. For example, when the shooting mode setting operation is an upward flick operation, the control unit <NUM> rotates the shooting mode setting image <NUM>-<NUM> in the counterclockwise direction. On the other hand, when the shooting mode setting operation is a downward flick operation, the control unit <NUM> rotates the shooting mode setting image <NUM>-<NUM> in the clockwise direction. The control unit <NUM> then highlights a shooting mode symbol <NUM> marked at the right end of the shooting mode setting image <NUM>-<NUM>. Then, the control unit <NUM> sets the current shooting mode to a shooting mode indicated by the shooting mode symbol <NUM>.

<FIG> illustrates a shooting mode setting image <NUM>-<NUM> as another example of the shooting mode setting image according to the invention.

The shooting mode setting image <NUM>-<NUM> is an image with a vertical belt shape. In the shooting mode setting image <NUM>-<NUM>, a plurality of shooting mode symbols <NUM> that indicate a shooting mode are marked in the vertical direction, and a shooting mode symbol <NUM> in the middle of these shooting mode symbols <NUM> is highlighted. The shooting mode symbol <NUM> indicates a shooting mode that is currently set.

The control unit <NUM> moves the shooting mode setting image <NUM>-<NUM> in the vertical direction depending on a shooting mode setting operation. For example, when the shooting mode setting operation is an upward flick operation, the control unit <NUM> moves the shooting mode setting image <NUM>-<NUM> in the upward direction. On the other hand, when the shooting mode setting operation is a downward flick operation, the control unit <NUM> moves the shooting mode setting image <NUM>-<NUM> in the downward direction. Then, the control unit <NUM> highlights a shooting mode symbol <NUM> marked in the middle of the shooting mode setting image <NUM>-<NUM>. Then, the control unit <NUM> sets the current shooting mode to a shooting mode indicated by the shooting mode symbol <NUM>.

The shooting mode setting image <NUM>-<NUM> is an image with a vertical dial shape (slot type). In the shooting mode setting image <NUM>-<NUM>, a plurality of shooting mode symbols <NUM> that indicate a shooting mode are marked in the vertical direction. A shooting mode symbol <NUM> in the middle of these shooting mode symbols <NUM> is highlighted. The shooting mode symbol <NUM> indicates a shooting mode that is currently set.

The control unit <NUM> rotates the shooting mode setting image <NUM>-<NUM> in the vertical direction depending on a shooting mode setting operation. For example, when the shooting mode setting operation is an upward flick operation, the control unit <NUM> rotates the shooting mode setting image <NUM>-<NUM> in the upward direction. On the other hand, when the shooting mode setting operation is a downward flick operation, the control unit <NUM> rotates the shooting mode setting image <NUM>-<NUM> in the downward direction. The control unit <NUM> highlights a shooting mode symbol <NUM> marked in the middle of the shooting mode setting image <NUM>-<NUM>.

Then, the control unit <NUM> sets the current shooting mode to a shooting mode indicated by the shooting mode symbol <NUM>.

The control unit <NUM> may change the arrangement sequence of the shooting mode symbols <NUM> on the shooting mode setting images <NUM>-<NUM> to <NUM>-<NUM>, in an optional manner or depending on an input operation performed by the user. This is similarly applicable to the widget image <NUM>.

As described above, the control unit <NUM> determines a widget image to be arranged in each layer based on a shooting mode. Furthermore, the control unit <NUM> may determine a widget image to be arranged in each layer based on the user's input operation (a setting image selection operation).

Specifically, when an input operation for shifting to a widget image selection mode (for example, operation for depressing any portion of the operation unit <NUM> for a long time) is performed, the control unit <NUM> proceeds to the widget image selection mode.

When the process proceeds to the widget image selection mode, the control unit <NUM> displays layer frame images 1010a, 1010b, and 1010c and a widget icon list image <NUM> as shown in <FIG>.

The layer frame image 1010a indicates an arrangement target layer in which a widget image is to be arranged (a display layer in the initial state). The layer frame image 1010b indicates a layer having the layer number lower by one than that of the display layer, and the layer frame image 1010c indicates a layer having the layer number higher by one than that of the display layer. When the user performs an arrangement target layer switching operation (for example, a horizontal flick operation), the control unit <NUM> may switch an arrangement target layer. For example, when the right flick operation is performed, the control unit <NUM> may set the arrangement target layer as a layer having the layer number lower by one than that of the current arrangement target layer. In addition, when the left flick operation is performed, the control unit <NUM> may set the arrangement target layer as a layer having the layer number higher by one than that of the current arrangement target layer. In addition, in the widget image selection mode, the control unit <NUM> may highlight an indicator corresponding to the arrangement target layer of the display layer indicators 210a to 210e.

The widget icon list image <NUM> includes a belt image 2000a, a shift (scroll) instruction buttons 2000b and 2000c, a plurality of widget icons <NUM> to <NUM>, and widget name images 2010a to 2060a. The belt image 2000a is a strip-shaped image extending in the left and right direction, and can be shifted (scrolled) in the left and right direction. The shift instruction buttons 2000b and 2000c are buttons for shifting the belt image 2000a. In other words, when the user taps the shift instruction button 2000b, the control unit <NUM> shifts (scrolls) the belt image 2000a in the left direction. On the other hand, when the user taps the shift instruction button 2000c, the control unit <NUM> shifts the belt image 2000a in the right direction. The control unit <NUM> may shift the belt image 2000a by the horizontal flick operation.

The widget icons <NUM> to <NUM> represent a widget image using an icon, and are arranged in the longitudinal direction of the belt image 2000a. The widget name images 2010a to 2060a are arranged below the widget icons <NUM> to <NUM> and indicate the name of the widget image.

The user drags a widget icon into the layer frame image 1010a. This enables the user to select a widget image corresponding to the widget icon. The control unit <NUM> arranges the widget image selected by the user in the arrangement target layer. For example, when the user drags the widget icon <NUM> into the layer frame image 1010a, the control unit <NUM> arranges the widget image <NUM> in the arrangement target layer (the third layer for this example) as shown in <FIG>.

The widget image <NUM> is an image that is used to set (select) a drive mode, and includes a plurality of drive mode icons 960a that indicate a drive mode. Any one of the drive mode icons 960a is highlighted. The highlighted drive mode icon 960a, that is, a drive mode icon 960b indicates the drive mode being currently set.

In other words, when the user taps any one of the drive mode icons 960a, the control unit <NUM> highlights the drive mode icon 960a tapped by the user. Then, the control unit <NUM> sets a drive mode indicated by the highlighted drive mode icon 960a, that is, the drive mode icon 960b as the current drive mode.

The control unit <NUM> cancels the widget image selection mode based on the user's operation. For example, when the user depresses the layer frame image 1010a for a long time, the control unit <NUM> cancels the widget image selection mode.

Thus, the user can arrange a desired widget image in a desired layer. For example, the user can customize a combination between widget images as desired depending on the purpose of shooting.

When the user selects a widget image, the control unit <NUM> may present (recommend) a relevant widget image associated with the selected widget image. For example, the control unit <NUM> may arrange the relevant widget image in the same layer as a layer in which the widget image selected by the user is arranged, or may arrange the relevant widget image in a different layer from a layer in which the widget image selected by the user is arranged. In addition, the control unit <NUM> may highlight a widget icon corresponding to the relevant widget image of the widget icons on the belt image 2000a. In addition, the control unit <NUM> may present the relevant widget image using audio.

The relevant widget image may be preset, or may set based on the user's use history. In the latter case, for example, if the number of times that a plurality of widget images are used in the same layer is greater than or equal to a predetermined value, then the control unit <NUM> may determine that these widget images are associated with one another.

The control unit <NUM> may set a shooting mode based on the widget image selected by the user. For example, when a widget image suitable for a panorama mode (a widget image for setting, for example, angle-of-view correction) is selected, the control unit <NUM> may set a shooting mode as the panorama mode.

The control unit <NUM> determines a widget image to be arranged in each layer based on a shooting mode. The shooting mode includes a shooting scene. Thus, the control unit <NUM> may determine a widget image based on the shooting scene. An example thereof will be described with reference to <FIG> and <FIG>. When the shooting mode is set to a shooting scene selection mode (SCN), the control unit <NUM> arranges a shooting scene selection image <NUM> in a display layer (the second layer for this example) as shown in <FIG>. The control unit <NUM> also may arrange another widget image in each layer.

The shooting scene selection image <NUM> includes shooting scene icons 1020a to 1020f that indicate a shooting scene. The control unit <NUM> sets a shooting scene depending on the user's input operation. The input operation includes, for example, an operation of tapping any one of the shooting scene selection icons 1020a to 1020f.

The control unit <NUM>, when setting a shooting scene, determines a widget image to be arranged in each layer based on the shooting scene. For example, when the shooting scene is set to "night portrait" (corresponding to a shooting scene icon 1020e), the control unit <NUM> arranges the widget images <NUM> and <NUM> in any one layer (the second layer for this example) as shown in <FIG>.

The widget image <NUM> is an image used to set (adjust) the beauty effect, and includes a gauge image 1030a, a pointer 1030b, and beauty effect setting buttons 1030c to 1030e. The gauge image 1030a is a strip-shaped image having a scale formed in the longitudinal direction. Each scale indicates the action amount of the beauty effect (the amount indicating that which one of beauty effects acts on a captured image). The pointer 1030b indicates the action amount of the current beauty effect.

The control unit <NUM> moves the pointer 1030b in the left and right direction depending on the user's input operation. In this case, the input operation includes, for example, an operation of dragging and dropping the pointer 1030b and an operation of tapping a desired point on the gauge image 1030a. The control unit <NUM> changes the action amount of the beauty effect to a value indicated by the pointer 1030b.

The beauty effect setting buttons 1030c to 1030e are buttons used to set the types of beauty effect to be adjusted. The control unit <NUM> adjusts the beauty effect corresponding to a button tapped by the user from among the beauty effect buttons 1030c to 1030e.

When the use state of the display unit <NUM> (display <NUM>) is changed, the control unit <NUM> maintains the positional relationship between the widget images. In addition, the control unit <NUM> adjusts the magnification of a widget image so that the widget image fits within the display unit <NUM>. The positional relationship refers to the display position of each widget image relative to another widget image.

A display example will be described with reference to <FIG> and <FIG>. When the widget images <NUM> to <NUM> are arranged in the first layer and the display unit <NUM> is used in the landscape orientation, the control unit <NUM> displays, for example, an image shown in <FIG>. When the use state of the display unit <NUM> is changed to the portrait orientation, the control unit <NUM> maintains the positional relationship between the widget images <NUM> to <NUM> and reduces the size of the widget images <NUM> to <NUM> as shown in <FIG>. For example, the widget image <NUM> is displayed on the upper side of the widget image <NUM> as shown in <FIG>, and thus the control unit <NUM> displays the widget image <NUM> on the upper side of the widget image <NUM> even when the use state of the display unit <NUM> is changed to the portrait orientation.

The control unit <NUM> also may adjust the positional relationship between widget images depending on the use state. For example, when the use state of the display unit <NUM> is changed to the landscape orientation, the control unit <NUM> may arrange the widget images <NUM> to <NUM> in the up and down direction.

Other processes are now described with reference to <FIG>. The control unit <NUM> may display an undo button <NUM>, a reset button <NUM>, and a lock button <NUM> together with a display layer. When the user taps the undo button <NUM>, the control unit <NUM> restores the state of each image to the state of the operation performed previously by one operation by the user. When the reset button <NUM> is tapped, the control unit <NUM> restores the display state to its initial state. The control unit <NUM> may restore the display state for every layer to its initial state, or may restore the display state of the entire layer to its initial state. The control unit <NUM> may restore the display state to a state previously set (so-called custom reset). This function is useful, for example, at the time of demonstration of the information processing apparatus <NUM>. For example, when a demonstrator describes the operation of the information processing apparatus <NUM> to one user, the custom reset is performed before the demonstrator begins to describe it to another user. This makes it possible for the demonstrator to restore easily the display state of the information processing apparatus <NUM> to the state before the description to the one user.

When the lock button <NUM> is tapped, the control unit <NUM> rejects (refuse to accept) a user's input operation.

When the lock button <NUM> is tapped again, the control unit <NUM> accepts the input operation performed by the user. The display of any one of the undo button <NUM>, the reset button <NUM>, and the lock button <NUM> may be omitted. Some of these buttons may be a hard key.

As described above, according to the present embodiment, the information processing apparatus <NUM> displays any one layer of a plurality of layers in which a widget image is arranged on the display unit <NUM> as a display layer and switches the display layer. Furthermore, the information processing apparatus <NUM> sets a shooting parameter depending on an input operation. Thus, the user can set a shooting parameter using a desired widget image displayed on a desired layer, thereby setting the shooting parameter easily.

When the user performs the display layer switching operation, the information processing apparatus <NUM> switches a display layer. Thus, the user can display a desired layer easily.

The information processing apparatus <NUM> determines a widget image to be arranged in each layer based on a shooting mode, and thus it can arrange the widget image in each layer depending on the user's shooting purpose. Accordingly, the user can set a desired shooting parameter easily.

The information processing apparatus <NUM> determines the priority of a widget image based on a shooting mode, and sets a widget image to be arranged in each layer based on the priority. Thus, the user can find out more easily a desired widget image.

When the user performs the shooting mode setting operation, the information processing apparatus <NUM> displays a shooting mode setting image used to set a shooting mode. Thus, the shooting mode setting image is hardly obstructive to the user. In addition, the user can change easily a shooting mode to a desired mode by using the shooting mode setting image.

The information processing apparatus <NUM> performs control for arranging a widget image selected by the user in each layer. Thus, the user can arrange a desired widget image in a desired layer.

Furthermore, the information processing apparatus <NUM> performs control for presenting a relevant widget image associated with the widget image selected by the user. Thus, the user can grasp easily a shooting parameter that is necessary for a desired shooting and adjust easily the shooting parameter.

Moreover, the information processing apparatus <NUM> may arrange the relevant widget image in the same layer as a layer in which a widget image selected by the user is arranged, or may arrange the relevant widget image in a different layer from a layer in which a widget image selected by the user is arranged. This saves the user a lot of time and trouble trying to arrange the relevant widget image in a layer.

Furthermore, the information processing apparatus <NUM> sets a shooting mode based on a widget image selected by the user. Thus, the user can capture a desired image easily.

Moreover, the information processing apparatus <NUM> changes a way of performing the display layer switching operation depending on a shooting mode. Thus, the information processing apparatus <NUM> can reduce the possibility for the user to confuse the display layer switching operation with other operations.

When the use state of the display unit <NUM> is changed, the information processing apparatus <NUM> also maintains the positional relationship between widget images. Thus, even when the use state of the display unit <NUM> is changed, the user is much less likely to be confused.

The second embodiment is now described. In the second embodiment, the information processing apparatus and the imaging device are separated.

The configuration of the information processing system according to the second embodiment is now described with reference to <FIG>. The information processing system includes the information processing apparatus <NUM> and the imaging device <NUM>. The information processing apparatus <NUM> and the imaging device <NUM> can communicate with each other. The information processing apparatus <NUM> performs a process similar to that of the first embodiment described above. However, the information processing apparatus <NUM> acquires a through-the-lens image and a captured image by communication with the imaging device <NUM>. In addition, the information processing apparatus <NUM> outputs setting value information related to a setting value of a shooting parameter to the imaging device <NUM>.

The configuration of the information processing apparatus <NUM> is substantially similar to that of the first embodiment. In the second embodiment, the information processing apparatus <NUM> may not include the imaging unit <NUM>. The configuration of the imaging device <NUM> is now described.

As shown in <FIG>, the imaging device <NUM> includes a storage unit <NUM>, a communication unit <NUM>, an imaging unit <NUM>, a display unit <NUM>, an operation unit <NUM>, and a control unit <NUM>. The storage unit <NUM> stores a program which causes the imaging device <NUM> to execute functions of the storage unit <NUM>, the communication unit <NUM>, the imaging unit <NUM>, the display unit <NUM>, the operation unit <NUM>, and the control unit <NUM>. The storage unit <NUM> also stores various types of image information.

The communication unit <NUM> communicates with the information processing apparatus <NUM>. For example, the communication unit <NUM> transmits the through-the-lens image supplied from the control unit <NUM> to the information processing apparatus <NUM>. In addition, the communication unit <NUM> outputs the setting value information supplied from the information processing apparatus <NUM> to the control unit <NUM>. The imaging unit <NUM> captures an image. Specifically, the imaging unit <NUM> outputs an image captured by an image sensor to the control unit <NUM> as a through-the-lens image until the user performs a shooting operation (for example, an operation of depressing a shutter button which is not shown). When the user performs a shooting operation, the imaging unit <NUM> captures an image (specifically, performs an action such as releasing a shutter) depending on the setting values the Tv/Av value and ISO value. Then, the imaging unit <NUM> outputs the image captured by the image sensor to the control unit <NUM> as a captured image.

The display unit <NUM> displays various types of images, for example, a through-the-lens image and a captured image. The display unit <NUM> may display the widget image described above. The operation unit <NUM> includes a so-called hard key, which is disposed on each site of the imaging device <NUM>. The operation unit <NUM> outputs operation information related to the input operation performed by the user to the control unit <NUM>. The control unit <NUM> controls the entire imaging device <NUM>, and outputs a through-the-lens image to the communication unit <NUM>. In addition, the control unit <NUM> performs setting of the imaging unit <NUM> based on the setting value information.

The imaging device <NUM> has the hardware configuration shown in <FIG>, and such hardware configuration allows the storage unit <NUM>, the communication unit <NUM>, the imaging unit <NUM>, the display unit <NUM>, the operation unit <NUM>, and the control unit <NUM> to be executed.

In other words, the imaging device <NUM> is configured to include a non-volatile memory <NUM>, a RAM <NUM>, a communication device <NUM>, an imaging hardware <NUM>, a display <NUM>, an operation device (for example, a hard key) <NUM>, and a CPU <NUM>, as its hardware configuration.

The non-volatile memory <NUM> stores, for example, various programs and image information. The program stored in the non-volatile memory includes a program which causes the imaging device <NUM> to execute functions of the storage unit <NUM>, the communication unit <NUM>, the imaging unit <NUM>, the display unit <NUM>, the operation unit <NUM>, and the control unit <NUM>.

The RAM <NUM> is used as a work area of the CPU <NUM>. The communication device <NUM> communicates with the information processing apparatus <NUM>. The imaging hardware <NUM> has a configuration similar to that of the imaging device <NUM>. In other words, the imaging hardware <NUM> captures an image and generates a captured image. The display <NUM> displays various types of image information. The display <NUM> may output audio information. The operation device <NUM> accepts various input operations performed by the user.

The CPU <NUM> reads out and executes the program stored in the non-volatile memory <NUM>. Thus, the CPU <NUM>, which reads out and executes the program stored in the non-volatile memory <NUM>, allows the imaging device <NUM> to execute functions of the storage unit <NUM>, the communication unit <NUM>, the imaging unit <NUM>, the display unit <NUM>, the operation unit <NUM>, and the control unit <NUM>. In other words, the CPU <NUM> functions as a component for practically operating the imaging device <NUM>.

The process of the information processing system is similar to the process performed by the information processing apparatus <NUM> described above. However, the information processing system is different from the first embodiment in that the imaging device <NUM> creates a through-the-lens image and transmits it to the information processing apparatus <NUM> and the information processing apparatus <NUM> transmits setting value information to the imaging device <NUM>.

According to the second embodiment, the user also can easily set a shooting parameter. In addition, the user can remotely operate a shooting parameter of the imaging device <NUM> using the information processing apparatus <NUM>, thereby further improving the usability of widget image.

According to the first and second embodiments, the above and other advantages will become apparent from the description given herein.

Claim 1:
An information processing apparatus (<NUM>), comprising:
a display device having a touch panel arranged on a surface; and
a processor (<NUM>) configured to:
control the display device to display a through-the-lens image;
control the display device to display a first shooting parameter-setting image of a plurality of shooting parameter-setting images, wherein the first shooting parameter-setting image is displayed superimposed on the through-the-lens image output by an image sensor;
control the display device to display a selected shooting mode indicator (<NUM>) indicating a selected shooting mode from a plurality of shooting modes;
control the display device to switch the selected shooting mode to another shooting mode based on a flick operation on the touch panel; characterised in that the processor is further configured to control the display device to switch display of the first shooting parameter-setting image with a second shooting parameter-setting image of the plurality of shooting parameter-setting images based on the flick operation.