An information processing apparatus includes a memory, and a processor configured to display a first, selectable image at first position on a display, display a second image over at least part of the first image so as to hide the at least part of the first image, and, when the second image is displayed over the at least part of the first image, exert control so as to receive an operation for making the first image visible and selectable while continuing to display the second image at the first position.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2020-097399 filed Jun. 4, 2020.

BACKGROUND

(i) Technical Field

(ii) Related Art

Japanese Unexamined Patent Application Publication No. 2018-045421 discloses an image forming apparatus in which, when a second image such as a banner is superimposed on at least a part of a first image such as an icon, the display position of at least one of the images, the first image and the second image, is changed. Thus, the image forming apparatus achieves suppression of the state in which a user, who is going to select the second image, selects the first image erroneously.

SUMMARY

Aspects of non-limiting embodiments of the present disclosure relate to an information processing apparatus and a non-transitory computer readable medium. Even when a second image is displayed so as to be superimposed on the display area, in which a first image which is selectable is displayed, the information processing apparatus and the non-transitory computer readable medium may receive an operation of causing the first image to be recognized visually with the second image being displayed, and to be selected.

According to an aspect of the present disclosure, there is provided an information processing apparatus including a memory, and a processor configured to display a first, selectable image at first position on a display, and to display a second image over at least part of the first image so as to hide the at least part of the first image is invisible. When the second image is displayed over the at least part of the first image, the processor is configured to exert control so as to receive an operation for making the first image visible and selectable while continuing to display the second image at the first position.

DETAILED DESCRIPTION

An exemplary embodiment of the present disclosure will be described in detail below by referring to the drawings.

FIG. 1is a diagram illustrating the system configuration of an information processing system according to an exemplary embodiment of the present disclosure.

As illustrated inFIG. 1, the information processing system according to an exemplary embodiment of the present disclosure includes a mobile terminal10and server apparatuses20which provide various services. The mobile terminal10is connected to the server apparatuses20through a wireless local-area network (LAN) terminal30and the Internet40. The mobile terminal10according to the present exemplary embodiment is, for example, an information processing apparatus such as a smartphone.

FIG. 2illustrates the hardware configuration of the mobile terminal10in the information processing system according to the present exemplary embodiment.

As illustrates inFIG. 2, the mobile terminal10includes a central processing unit (CPU)11, a memory12, a storage device13such as a flash memory, a communication interface (IF)14which receives/transmits data from/to external apparatuses or the like over a public mobile phone network or the Internet40, and a user interface (UI) apparatus15such as a touch panel. These components are connected to each other through a control bus16.

The CPU11is a processor which performs predetermined processes on the basis of control programs stored in the memory12or the storage device13and which controls the operations of the mobile terminal10. In the present exemplary embodiment, the CPU11is described as a component which reads, for execution, control programs stored in the memory12or the storage device13. Alternatively, the programs may be stored in an external storage medium to be provided to the CPU11.

FIG. 3is a block diagram illustrating the functional configuration of the mobile terminal10implemented through execution of the control programs.

As illustrated inFIG. 3, the mobile terminal10according to the present exemplary embodiment includes an operation input unit31, a display unit32, a data receiving/transmitting unit33, a controller34, and a data storage unit35.

The operation input unit31receives information about various operations performed by a user. The display unit32, which is controlled by the controller34, displays various information to the user. The operation input unit31and the display unit32form a touch panel.

The data receiving/transmitting unit34receives/transmits data from/to external apparatuses such as the server apparatuses20. The controller34controls the entire operation of the mobile terminal10. The data storage unit35stores various data used when the controller34performs various processes.

In execution of various processes, the controller34controls the display unit32to display various operation screens to a user and receive various operations from the user. On such operation screens, display elements for receiving input about operations, such as menu screens and various setting screens, are displayed. In addition, messages for assisting user operations, such as guidance display describing functions, and prohibitive rules in setting functions, may be displayed as display elements. To notify a user of such a message, a banner image may be displayed so as to be superimposed on a display element for receiving a user operation.

However, a position at which the banner image is displayed on an operation screen may be often set in advance, for example, to the top end or the bottom end. Assume that a banner image is displayed on an operation screen at the display position of a display element for receiving input, such as a selection button, and is thus superimposed on the display element. Such a banner image causes a user not to be able to operate the display element for receiving input and perform various types of input.

In particular, assume the case in which a user is notified of some error notification and the like by using a banner image, and in which there is no way for the user to dismiss the banner image through the user's operation. In this case, the user is not able to input various operations until the error is resolved.

A concrete example provided when the controller34displays a banner image on the display unit32will be described by referring toFIGS. 4 and 5.

For example, the description will be made under the assumption that the operation screen illustrated inFIG. 4is displayed on the display screen of the mobile terminal10. The example inFIG. 4illustrates an exemplary operation screen displayed when a navigation application program for guiding a user to a destination is invoked. Operation buttons51for destination search and the like are displayed on the operation screen.

FIG. 5illustrates an example in which a banner image52is displayed on the operation screen. In the exemplary operation screen illustrated inFIG. 5, the banner image52for notifying a user of failure to receive GPS signals is displayed in a top end portion of the operation screen.

The banner image52, which is thus displayed on the operation screen, covers the operation buttons51which have been displayed on the operation screen, causing the user not to be able to operate the operation buttons51.

The banner image52is an image which is not dismissible through a user operation on the banner image52. For example, the banner image52is an image which is dismissible by resolving the error which has occurred in the terminal apparatus10or a different apparatus. In the present exemplary embodiment, the banner image52is used to notify a user of an error indicating that GPS signals fail to be received. When GPS signals start to be received, the banner image52is dismissed automatically.

In the case where the banner image52continues to be displayed until GPS signals start to be received, the user is not able to operate the operation buttons51until the GPS signals start to be received.

Therefore, the mobile terminal10according to the present exemplary embodiment exerts control, which is described below, so as to enable the following operation. Even when the banner image52is displayed so as to be superimposed on the display area in which the image of the selectable operation buttons51and the like is displayed, the operation causes the image of the operation buttons51and the like to be recognized visually and selected with the banner image52being displayed.

Specifically, the image of the selectable operation buttons51and the like is displayed on the operation screen, and the banner image52is displayed in an area including the display area of the image of the operation buttons51and the like so that at least a part of the image of the operation buttons51and the like, on which the banner image52is superimposed, is not capable of being recognized visually. At that time, the controller34exerts control described below.

When the banner image52is displayed so that at least a part of the image of the operation buttons51and the like, on which the banner image52is superimposed, is not capable of being recognized visually, the controller34exerts control so as to receive an operation of enabling the image of the operation buttons51and the like to be recognized visually and selected with the banner image52being displayed in the area.

Specifically, when the banner image52is displayed so that at least a part of the image of the operation buttons51and the like, on which the banner image52is superimposed, is not capable of being recognized visually, the controller34exerts control to receive such an operation that the image of the operation buttons51and the like is moved so that the banner image52is not superimposed on the image of the operation buttons51and the like. That is, the image of the operation buttons51and the like has an original configuration in which the display position of the image is not moved through a user's operation. Regardless of this original configuration, control is exerted so that display of the banner image52superimposed on the image of the operation buttons51and the like causes the display position to be moved through a user's operation.

The state in which such control is exerted will be described by referring toFIGS. 6 to 8.

FIG. 6illustrates the state in which a user taps an operation screen for scrolling, when the banner image52is displayed so as to cover the operation buttons51.

The user performs such a scroll operation. Thus, the entire operation screen, which has an original configuration in which the operation screen is not compatible with scroll display, moves as illustrated inFIG. 7. As a result, as illustrated inFIG. 8, the operation buttons51are moved to a position at which the banner image52is not superimposed on the operation buttons51. Therefore, the user may recognize the operation buttons51visually and may operate the operation buttons51with the banner image52being displayed.

After the user performs a scroll operation to a position at which at least a part or the entirety of the operation buttons51may be recognized visually, even when the scroll operation is stopped, the display may remain on the operation screen in the state in which the operation buttons51are capable of being recognized visually. The operation buttons51may scroll to any position on the operation screen, for example, to a position which is below the position of the operation buttons51inFIG. 8. Alternatively, the display may remain in the state in which the operation buttons51are visually recognizable at the position at which the scrolling is stopped. After the operation buttons51scroll, the image of an operation button or the like which receives an operation for making the operation buttons51enter the visually unrecognizable state from the visually recognizable state may be displayed. The image may be displayed so as to be superimposed on an image53in an area including the operation buttons51, or may be displayed at any position on the operation screen.

Exemplary Embodiment using an Operation Screen having the Scroll Function

In the exemplary embodiment, the case in which a banner image is displayed on an operation screen, which does not have a scroll function originally, is described. A case in which a banner image is displayed on an operation screen having the scroll function will be described below.

In the present exemplary embodiment, the controller34moves list information, having multiple items, vertically or horizontally on the basis of a user's operation, and performs scroll display to display some items in the list information on the display area, as an image on the operation screen.

A concrete example performed by the controller34when a banner image is displayed on an operation screen having the scroll function will be described by referring toFIGS. 9 to 11.

The description will be made, for example, under the assumption that the operation screen as illustrated inFIG. 9is displayed on the display screen of the mobile terminal10.FIG. 9is a diagram illustrating an exemplary operation screen having the scroll function.FIG. 9illustrates an example in which an electronic-mail reception/transmission application program is invoked, and in which received electronic mails are displayed in a list on the exemplary operation screen. On the operation screen, in addition to list information of multiple received mails, operation buttons61, such as a search button and a sort button, are displayed. In an end portion on the right of the operation screen, a scroll bar70is displayed. The scroll bar70indicates the position and the ratio, in the scroll range, of the image of the operation screen displayed in the display area.

The relationship between the scroll range and the display area in the scroll display will be described by referring toFIG. 10.

FIG. 10illustrates the state in which, in the case where information to be displayed needs a wider area than the display area assigned on the display screen, the entire information to be displayed is regarded as the scroll range and scroll display is performed. In the scroll display, the display area is moved in accordance with a scroll operation, and part of information which is included in the display area in the scroll range is displayed on the operation screen.

FIG. 11illustrates an exemplary case in which a banner image62is displayed on the operation screen on which such scroll display is performed. On the exemplary operation screen illustrated inFIG. 11, the banner image62for notifying a user of advertisement information is displayed in a top end portion of the operation screen. In the present exemplary embodiment, the case in which a banner image is displayed so as to be superimposed in a top end portion of an operation screen which scrolls vertically will be described. The present disclosure may be applied similarly to the case in which a banner image is displayed so as to be superimposed in a bottom end portion. In the case of horizontal scrolling, the present disclosure may be applied similarly to the case in which a banner image is displayed so as to be superimposed in a left end portion or a right end portion of an operation screen.

When the banner image62is thus displayed on the operation screen, the operation buttons61which have been displayed on the operation screen are covered by the banner image62, and a user is not able to operate the operation buttons61.

In scroll display, the display content is moved due to the user's scroll operation. In the case where the banner image62is displayed at the top end of the operation screen, the banner image62is superimposed on the operation buttons61which are disposed at the top end of the scroll range even when the user scrolls down as much as possible.

In the present exemplary embodiment, assume the case in which a banner image is displayed so as to be superimposed in an end portion, in the scroll direction, of the display area. In this case, the controller34changes, in the scroll display, the scroll range of the image for the operation screen so that, even when the image on the operation screen is scrolled and the display area is moved to the end portion of the scroll range, the end portion area is displayed, not hidden by the banner image.

Specifically, when the banner image62is displayed so as to be superimposed in an end portion, in the scroll direction, of the image of the operation screen, the controller34adds an area, having the same length as the banner image62, on side, on which the banner image62is displayed and superimposed, of the scroll range of the image of the operation screen. Thus, even when the image of the operation screen is scrolled and the display area is moved to an end portion of the scroll range, the area in the end portion is displayed, not hidden by the banner image62.

That is, in the case where a reception button for receiving a user operation is included in the area in an end portion of the scroll range of the image of an operation screen, the controller34causes the reception button to be displayed, not to be hidden by the banner image62, even when the image of the operation screen is scrolled and the display area is moved to the end portion of the scroll range.

The controller34displays the image of the operation screen, as well as the scroll bar indicating the position in the scroll range of the image of the operation screen displayed in the display area. Therefore, the controller34changes the display position of the scroll bar when the banner image62is displayed so as to be superimposed on the image of the operation screen.

The controller34shows the ratio, in the scroll range, of the image of the operation screen displayed in the display area, as the size of the scroll bar. Therefore, the controller34changes the size of the scroll bar when the banner image62is displayed so as to be superimposed on the image of the operation screen.

Operations performed by the controller34when the banner image62is displayed so as to be superimposed on the operation screen having the scroll function will be described by referring to the flowchart inFIG. 12.

In step S101, the controller34displays the banner image62so as to be superimposed on an operation screen on which scroll display is performed.

In step S102, the controller34adds the height, that is, the vertical length, of the banner image62to the scroll range.

For example, in the case where the scroll range of the exemplary operation screen illustrated inFIG. 9is the range illustrated inFIG. 13, the scroll range used when the banner image62is superimposed is the range illustrated inFIG. 14.

That is, it is seen that the scroll range used when the banner image62is superimposed is the range obtained by adding the vertical length of the banner image62to the scroll range illustrated inFIG. 13.

In step S103, the controller34determines whether or not the scroll range obtained after addition of the vertical length of the banner image62is larger than that of the display area.

If the scroll range is smaller than that of the display area, it is possible to display the entire display content in the original scroll range without scroll display. Thus, the scroll bar70does not need to be displayed.

If the scroll range is equal to or smaller than that of the display area, the controller34ends the process. If the scroll range is larger than that of the display area, the controller34updates display of the scroll bar70in step S104.

Even if the scroll range before addition of the vertical length of the banner image62to the scroll range is larger than that of the display area, the size of the scroll bar70needs to be changed due to the increase of the scroll range, and the display position of the scroll bar70needs to be changed due to the change of the current display position.

Therefore, even if the scroll range before addition of the vertical length of the banner image62to the scroll range is larger than that of the display area, display of the scroll bar70needs to be updated.

FIG. 15illustrates an exemplary operation screen on the mobile terminal10for which the scroll range is thus changed. On the operation screen illustrated inFIG. 15, relative to the operation screen illustrated inFIG. 11, the size of the scroll bar70is made smaller and the display position has been moved downward.

The size of the scroll bar70is made smaller. The reason is that, since the size of the scroll bar70indicates the ratio of the display area to the entire scroll range, the length of the entire scroll range is larger by the vertical length of the banner image62, and the size of the display area itself is not changed.

Display of the scroll bar70does not necessarily match the scrollable range. The size and the position of the scroll bar70do not necessarily match the ratio and the position, in the scroll range, of the display area. That is, even when the scroll bar70is located in the topmost portion, if the banner image62is displayed so as to be superimposed, scrolling may be performed downward farther by the vertical length of the banner image62.

The scroll range has been thus changed. As illustrated inFIG. 15, when a user touches the operation screen to perform a scroll-down operation, the operation screen is moved further as illustrated inFIG. 16. As a result, as illustrated inFIG. 17, the operation buttons61are moved to a position at which the banner image62is not superimposed on the operation buttons61. With the banner image62being displayed, the user may recognize the operation buttons61visually, and may operate the operation buttons61.

FIGS. 15 to 17are used to describe the case in which the operation screen is scrolled down further through a normal scroll operation called a flick operation. If a scroll operation is enabled in a wider range than a normal one by changing the scroll range, scroll display may be performed through an operation different from the normal operation.

For example, when a user continues to touch an operation screen for several seconds or more and the hold state is entered, a scroll operation may be enabled.

FIGS. 18 and 19illustrate an exemplary operation performed when the hold state enables a scroll operation.

On the operation screen illustrated inFIG. 18, a normal scroll operation called a flick operation does not cause the screen to be scrolled. When a user keeps the tap state for a certain period or more and a transition to the hold state is made as illustrated inFIG. 19, a scroll operation is enabled.

In the exemplary embodiment described above, the banner image62, which is displayed on the operation screen, causes the normal scroll range to be extended so that a display element, on which the banner image62is superimposed, may be moved to a position at which the banner image62does not cover the display element.

However, if there is dependence between multiple display elements displayed on the operation screen, such change of the normal scroll range may cause a problem.

Dependence between multiple display elements means the case in which an operation needs to be performed on a certain display element and a different display element collaboratively. That is, the dependence means that there is the following relationship: a certain display element is selected, and a different display element is then operated so that a specific process is performed.

A concrete example of the case in which there is dependence between display elements will be described by referring toFIGS. 20 to 24.

The exemplary operation screen illustrated inFIG. 20will be described under the assumption that there is dependence between a change button81and a preset button82. Specifically, the preset button82is selected, and the change button81is then pressed so that an input process is started. Thus, the description will be made under the assumption that the change button81and the preset button82are operated collaboratively so that a specific process is performed.

FIG. 21illustrates the state in which a banner image83is displayed on the operation screen and the change button81is hidden. On the operation screen illustrated inFIG. 21, the banner image83is superimposed on the change button81which is not capable of being operated.

FIG. 22illustrates an exemplary operation screen displayed when the scroll range is extended by the vertical length of the banner image83by using the method described above. On the exemplary operation screen illustrated inFIG. 22, the operation screen may be scrolled down further so that the change button81is moved to a position at which the change button81is not hidden by the banner image83. However, the scroll operation of moving the change button81causes the preset button82to be located outside the display area and not to be displayed.

Two display elements, which have dependence, that is, the change button81and the preset button82, are set as follows. The size of the display area and the positions of the change button81and the preset button82are set so that the change button81and the preset button82are always displayed at the same time. Regardless of this, a change of the scroll range may cause the state in which the change button81and the preset button82are not displayed at the same time.

If the two display elements which have dependence are not displayed at the same time, the visuality of a user operation decreases, and the operability degrades.

In the case where there is dependence between multiple display elements, when a change of the scroll range may cause the display elements not to be displayed at the same time, the display elements are reduced in size for display. Specifically, as illustrated inFIG. 23, each display element on the operation screen is reduced in size so that the preset button82remains in the display area even when the change button81is moved to a position at which the banner image83is not superimposed on the change button81.

Alternatively, display elements may be rearranged and displayed so that the multiple display elements are not prevented from not being displayed at the same time. Specifically, when a change of the scroll range may cause the multiple display elements not to be displayed at the same time, the display position of the preset button82is changed as illustrated inFIG. 24. When the change button81is moved to a position at which the banner image83is not superimposed on the change button81, the preset button82remains in the display area.

Modified Example

In the exemplary embodiment described above, the case in which a banner image is displayed on an operation screen of a mobile terminal such as a smartphone is described. The present disclosure is not limited to this. Similarly, the present disclosure may be applied to the case in which notification images such as banner images are displayed so as to be superimposed on the operation screens of various information processing apparatuses, such as an image forming apparatus and a personal computer.