INFORMATION PROCESSING APPARATUS, METHOD OF CONTROLLING THE SAME, AND STORAGE MEDIUM

An information processing apparatus sets, to visible, a display attribute of one UI screen among a plurality of UI screens arranged in multiple layers in a web page, and set, to invisible, the display attribute of the other UI screens, and controls to display, on a display unit, a UI screen among the plurality of UI screens that has the display attribute set to visible by the setting unit. In response to an instruction to switch a UI screen displayed on the display unit, the information processing apparatus changes the display attribute of the UI screen among the plurality of UI screens displayed before switching, from visible to invisible, and changes the display attribute of a UI screen displayed after switching, from invisible to visible.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to an information processing apparatus, a method of controlling the same, and a storage medium.

Description of the Related Art

Apparatus equipped with a web browser is widely used, which displays a browsable web page by analyzing web content. For instance, in a communication terminal equipped with a web browser, it is possible to use an operation screen created with web content. By using the operation screen created with the web content, it becomes unnecessary to install software dedicated for displaying the operation screen. In addition, it is possible to designate a layer in the web content and thus the operation screen created with the web content can be arranged in a plurality of layers. Japanese Patent Laid-Open No. 2000-347645 discloses a technology in which, in a case where image content such as a menu bar on a web page is displayed on an upper layer from the web content that is currently being viewed, the menu bar is made transparent to prevent the web content from being hidden by the menu bar.

In a case where there are a plurality of operation screens created with web content, the plurality of operation screens are each arranged on different web pages. In this case, different web pages are accessed every time transition of operation screen occurs, and thus it is necessary to access different URLs for each transition of the operation screen. For this reason, processing of obtaining web content or processing of analyzing the obtained web content is performed for each transition of operation screen, and then transition of operation screen takes time. This may decrease usability of a user, particularly in a case where resources (in particular, communication resources) of a communication terminal equipped with the web browser are not sufficient.

SUMMARY OF THE INVENTION

The present invention provides a technology that makes it possible to speed up transition of UI screens provided by a web page.

According to one aspect of the present invention, there is provided an information processing apparatus comprising: a setting unit configured to set, to visible, a display attribute of one UI screen among a plurality of UI screens arranged in multiple layers in a web page, and set, to invisible, the display attribute of the other UI screens; and a display control unit configured to control to display, on a display unit, a UI screen among the plurality of UI screens that has the display attribute set to visible by the setting unit, wherein in response to an instruction to switch a UI screen displayed on the display unit, the setting unit changes the display attribute of the UI screen among the plurality of UI screens displayed before switching, from visible to invisible, and changes the display attribute of a UI screen displayed after switching, from invisible to visible.

DESCRIPTION OF THE EMBODIMENTS

First Embodiment

In the first embodiment, an information processing apparatus equipped with a web browser transmits a request to a web server in displaying an operation screen, and receives web content constituting the operation screen from the web server. The information processing apparatus generates a plurality of operation screens overlapping in plural layers in accordance with the received web content. In a case where an operation screen is switched in response to a user operation, the information processing apparatus switches a display attribute (for instance, a visibility attribute or an Opacity attribute) of the operation screen described in the received web content to switch the operation screen. The information processing apparatus exemplified in the present embodiment has a communication function to communicate with the web server, and hereinafter, is referred to as a communication terminal.

FIG.1is a diagram illustrating an example of a configuration of a communication system according to the first embodiment. A communication terminal100is connected communicatively to a web server101, for instance, through a network103. The communication terminal100obtains web content used to generate a user interface screen (hereinafter, referred to as a UI screen) from the web server101via the network103. The communication terminal100, which is a digital camera or a multi-function apparatus, for instance, displays the UI screen on a liquid crystal display unit (display device211inFIG.1) by using web content obtained from the web server101. In the present embodiment, for instance, the Internet, a wide area network (WAN), a local area network (LAN), and a combination of these can be used as the network103. The web server101stores the web content, and distributes the web content to the communication terminal100as necessary. In the present embodiment, the web content includes HTML, CSS, JavaScript (trade name), an image file such as jpeg and png, and a moving image file such as mp4 and webm. Note that the CSS stands for Cascading Style Sheets.

FIG.1illustrates a block diagram illustrating an example of the hardware configuration of the communication terminal100according to the first embodiment. The CPU201is configured to control the communication terminal100. Note that the CPU stands for a Central Processing Unit. A ROM202is a read only memory configured to store a program or a parameter that does not need to be changed. Note that the ROM stands for a Read Only Memory. The RAM203is a memory configured to temporarily store a program or data supplied from an external apparatus or the like, and can be performed reading and/or writing as necessary. The RAM stands for a Random Access Memory. A GUI unit204includes a display device211, and displays the UI screen on the display device211to provide a user with a graphical user interface. The UI unit205is a user interface including a keyboard that receives an operation from the user to input data, an input device such as a physical button, a pointing device such as a mouse, or the like. The UI unit205includes a touch panel212arranged as overlapping on the display device211. A network interface206is configured to connect the communication terminal100to a network. Note that the communication terminal100may include a hard disk arranged in a fixed manner, a memory card, or the like. Alternatively, the communication terminal100may be configured to be connectable to a detachable external storage apparatus or the like, which includes a flexible disk (FD), an optical disk such as a compact disk (CD), a magnetic or optical card, an IC card, a memory card, or the like.

FIG.2Ais a block diagram illustrating a functional configuration example of the communication terminal100according to the present embodiment. Each function unit described below can be implemented, for instance, by causing the CPU201to execute a program stored in the ROM202or the RAM203. In addition, part of or all of the function units described below may be implemented, for instance, with dedicated hardware such as an ASIC.

The communication unit301is configured to control communication performed by the communication terminal100via the network interface206. A memory unit302is configured to store a specific operation performed to web content when the web content obtained from the web server101or the UI unit205is operated. An operation detecting unit303is configured to detect that the GUI unit204or the UI unit205is operated, and notifies a layer switching unit307of the detected operation information. The operation detecting unit303is also configured to perform determination processing of the detected operation type. A screen display unit304is configured to display the UI screen on a display screen of the GUI unit204.

A web content analysis unit305is configured to analyze the web content obtained from the web server101. A web content rendering unit306is configured to render the UI screen by a web page on the basis of a result of analysis of the web content by the web content analysis unit305and display the UI screen on the display device211. The web content includes a plurality of UI screens in a form of a plurality of layers in one web page. Below, description will be made using an operation screen that is one example of the UI screen. The web content analysis unit305and the web content rendering unit306are configured to render and display an operation screen in accordance with a visibility attribute or an opacity attribute set for the operation screen of each layer. The layer switching unit307is configured to change a value of the display attribute (a visibility attribute or an opacity attribute) of the operation screen generated by the web content, in response to an operation input from the GUI unit204or the UI unit205to the operation screen.

Returning toFIG.1, description will be made of an example of the hardware configuration of the web server101according to the first embodiment. A CPU401is configured to control the web server101. A ROM402is a read only memory, and configured to store a program and a parameter that do not need to be changed. A RAM403is a memory to which reading and/or writing can be performed as necessary, and configured to temporarily store a program or data supplied from an external apparatus or the like. A network interface404is configured to connect the web server101to a network.

FIG.2Bis a block diagram illustrating a functional configuration example of the web server101according to the first embodiment. A communication unit501is configured to control communication performed by the communication terminal100via the network interface404. Web content is stored in a memory unit502. For instance, the communication unit501transmits, to the communication terminal100, the web content (operation screen) stored in the memory unit502.

FIG.3is a diagram illustrating a description example of web content601distributed by the web server101to the communication terminal100. According to the description602inFIG.3, a plurality of operation screens are arranged at the same position on one web page in a plurality of layers. That is, a plurality of operation screens are arranged on one web page in multiple layers. Each of the plurality of operation screens is identified by an id element (ui01, ui02, ui03). In addition, JavaScript (trade name) processing for switching display attributes for each id is described between <script> and </script> (description603). The display attribute includes a first display attribute in which a visible operation screen is turned into an active state and an invisible operation screen is turned into an inactive state, and also includes a second display attribute in which visibility is changed while the active state of the operation screen is kept. Although detail of each of the display attributes will be described later, the first display attribute includes, for instance, the visibility of CSS, and the second display attribute includes, for instance, the opacity of CSS. Furthermore, in order to achieve a layered structure, the same absolute value is designated to the position attribute of CSS for each of the operation screens.

FIG.4is a diagram illustrating an example of display of operation screens by the screen display unit304. The operation screens illustrated inFIG.4are examples in which the screen display unit304displays a web page on a display screen of the GUI unit204on the basis of a result of analysis of the web content601by the web content analysis unit305. Each of operation screens701ato701cinFIG.4is an example of each of the plurality of operation screens defined by the web content601. The operation screen701a, the operation screen701b, the operation screen701care the example of display of the operation screen respectively defined by id=“ui01,” id=“ui02,” id=“ui03.”

A display state702is an example in which the operation screen701ais displayed in a web page including the operation screens701ato701cbeing overlapped as a plurality of layers. In the display state702, a square with the solid line indicates a layer in a visible state (Visibility=1), and a square with the dotted line indicates a layer in an invisible state (Visibility=0). For instance, in the display state702, the layer of the operation screen701adefined by id=“ui01” is in a visible state, and the layers of the operation screens701band701cdefined by id=“ui02” and id=“ui03” are in an invisible state. Thus, the operation screen displayed by the screen display unit304looks as if only the operation screen701adefined by id=“ui01” is displayed. The display state703is an example in which the operation screen701bis displayed in a web page including the operation screens701ato701cbeing overlapped as a plurality of layers. In the display state703, the layer of the operation screen defined by id=“ui02” is in the visible state, and the layers of the operation screens defined by id=“ui01” and id=“ui03” are in the invisible state. Thus, the operation screen displayed by the screen display unit304looks as if only the operation screen701bdefined by id=“ui02” is displayed.

Furthermore, in the present embodiment, when a user operation is performed to a region711(ui01 button), a region712(ui02 button), and a region713(ui03 button) of the operation screen, switching of operation screens is performed. When the operation detecting unit303detects a user operation to either the region711or the region712, the layer switching unit307switches the visible states of layers. For instance, when an operation screen of ui01 is displayed as in the display state702and an operation is performed to the region712(ui02 button) of the operation screen, the layer switching unit307performs an operation of making the operation screen of ui02 visible and making the other operation screens invisible. Through this processing, the display state703is obtained. As described above, by setting a value in the display attribute, visible and invisible of the operation screen can be switched. In a case where visible and invisible are switched by the first display attribute, an operation screen in an invisible state turns into an inactive state, and an operation item of this operation screen turns into disabled. On the other hand, in a case where visible and invisible are switched by the second display attribute, an operation screen in an invisible state is kept in the active state. That is, the operation item of an operation screen that is invisible is kept in the enabled state.

FIG.5is a flowchart used to explain a flow of processing of the communication terminal100according to the present embodiment. A user who uses the communication terminal100activates an operation screen using application, thereby processing of this flowchart starts. The operation screen using application is an application that displays an operation screen on the display device211and receives a user operation.

In S801, the communication unit301transmits, to the web server101serving as an external apparatus, a URL at which web content for displaying an operation screen is arranged. In S802, the communication unit301obtains, from the web server101, the web content corresponding to the URL transmitted in S801, and stores the web content in the memory unit302. In the present embodiment, description will be made on the assumption that the web content601illustrated inFIG.3is obtained from the web server101. In S803, the web content analysis unit305analyzes the web content601stored in the memory unit302in S802, and the web content rendering unit306renders the web content (operation screen) on the basis of a result of the analysis. In S804, the screen display unit304performs display control in which the content rendered by the web content rendering unit306in S803is displayed on the display device211of the GUI unit204. For instance, among the plurality of operation screens arranged in multiple layers in one web page, the display attribute of one operation screen is set to visible, and the display attributes of the other operation screens are set to invisible, in accordance with the description602inFIG.3. With the display control by the screen display unit304, the operation screen of which display attribute is set to visible among the plurality of operation screens is displayed on the display unit. In the present example, only the operation screen of id=“ui01” has the visibility attribute set to be “visible” in the description602of the web content601, and then the operation screen701ais displayed as illustrated in the display state702inFIG.4.

In S805, the operation detecting unit303detects a user operation to the GUI unit204or the UI unit205, and determines whether or not an instruction is given to switch operation screens (layers). In a case where it is determined that the instruction to switch operation screens is given (YES in S805), the processing proceeds to S806. In S806, the operation detecting unit303notifies the layer switching unit307of operation information instructing to switch operation screens. On the other hand, in a case where it is determined that the instruction to switch operation screens is not given (NO in S805), the processing proceeds to S809. As for operations performed to the operation screen, the operation detecting unit303can detect two different types of user operations that includes a first operation using, as operation information, coordinate information indicating an operation position on the web page, and a second operation using operation information stored in the memory unit302in association with an operation input.

The first operation (hereinafter, referred to as coordinate operation) obtains operation information with respect to a touch panel operation to the GUI unit204. The operation detecting unit303detects that a touch panel of the GUI unit204is operated, and outputs information indicating the touch position (coordinates) as click=(x, y). In a case where click=(x, y) obtained through the coordinate operation is a position corresponding to any of the regions711to713of the operation screen displayed on the display screen of the GUI unit204, the operation detecting unit303determines that an instruction to switch layers is given. In a case where it is determined that an instruction to switch layers is given (YES in S805), the processing proceeds to S806, and the layer switching unit307is notified of the touch position (click=(x, y)) as the operation information.

The second operation (hereinafter, referred to as specific operation) obtains operation information with respect to the operation to the UI unit205. The operation detecting unit303detects that the UI unit205is operated, and searches the memory unit302with the detected operation content. In a case where operation content that matches the detected operation content is stored in the memory unit302, the operation detecting unit303reads out, from the memory unit302, operation information stored in association with the operation content, and outputs it. In a case where operation content that matches the detected operation content is not stored in the memory unit302, it is determined that no specific operation is detected.

For instance, in a case where the right-arrow key of the physical button on the UI unit205is operated, the operation detecting unit303searches for the right-arrow key in the memory unit302. In the present embodiment, processing content (operation information) corresponding to the current display state are stored in the memory unit302as processing for the right-arrow key of the physical button of the UI unit205. More specifically, run_setVisiblityforUI02( ) is stored in association with the right-arrow key in a case where id of the operation screen being displayed is 01; run_setVisiblityforUI03( ) is stored in association with the right-arrow key in a case where id of the operation screen being displayed is 02; and run_setVisiblityforUI01( ) is stored in association with the right-arrow key in a case where id of the operation screen being displayed is 03. The processing described above is used to switch layers. Thus, when determining that an instruction to switch layers is given through operation with the right-arrow key (YES in S805), the operation detecting unit303notifies the layer switching unit307of, as the operation information, processing for the right-arrow key corresponding to the current display state in S806.

In S807, the layer switching unit307performs layer switching processing on the basis of the operation information received from the operation detecting unit303. That is, in accordance with the operation information of the switching instruction, the layer switching unit307changes the display attribute of an operation screen among the plurality of operation screens displayed before switching, from visible to invisible, and changes the display attribute of an operation screen displayed after switching, from invisible into visible. For instance, in a case where click=(x, y), indicated in the operation information notified through the coordinate operation, corresponds to the region712, the layer switching unit307fires setVisiblityforUI02( ) of the web content601. In addition, for instance, in a case where the operation information notified through the specific operation is run_setVisiblityforUI02( ), the layer switching unit307fires setVisiblityforUI02( ) of the web content601. When setVisiblityforUI02( ) is thus executed, the values of the visibility attributes of the operation screens of id=“ui01” and id=“ui03” turn into “hidden.” Furthermore, the value of the visibility attribute of the operation screen of id=“ui02” turns into “visible.”

In S808, the web content analysis unit305analyzes the web content on the basis of the value of the display attribute changed in S807, and the web content rendering unit306renders the web content. And then, the screen display unit304displays rendered content on the display screen of the GUI unit204. In the example of processing described above, the display state of the screen display unit304makes transition from the display state702to the display state703inFIG.4. This is because, among the operation screens specified in the web content601, id=“ui02” is the only operation screen having a value of the visibility attribute set to “visible.” In this manner, the displayed operation screen is switched from the operation screen701aof ui01 to the operation screen701bof ui02.

In S809, the operation detecting unit303determines whether or not termination processing is performed. The termination processing represents a case where a user terminates the operation screen using application of the communication terminal100by using the GUI unit204or the UI unit205. In a case where the termination processing is determined to be performed (YES in S809), the processing ends. In a case where the termination processing is determined not to be performed (NO in S809), the processing returns to S805, and the processing described above is repeated.

In this manner, according to the first embodiment, by changing a value of the attribute of web content, transition of operation screens can be implemented. This eliminates the need of performing processing for obtaining web content or analysis of the obtained web content every time the operation screen makes transition, which makes it possible to reduce the time required to transition the operation screens.

Second Embodiment

The second embodiment includes, in addition to the first embodiment, deciding an operation type for operation on an operation screen in activating an operation screen using application, and performing layer switching processing in accordance with the operation type. The operation type includes the coordinate operation and the specific operation described in the first embodiment. The hardware configuration and the functional configuration of the communication terminal100, and the system configuration according to the second embodiment are similar to those in the first embodiment (FIG.1,FIG.2A, andFIG.2B). Furthermore, the hardware configuration and the functional configuration of the web server101are also identical to those in the first embodiment (FIG.1,FIG.2A, andFIG.2B). According to the present embodiment, it is possible to switch operation screens in the coordinate operation or the specific operation and also, in the specific operation, transition the operation screens at a speed higher than that in the first embodiment.

FIGS.6A and6Bare diagrams illustrating a description example of web content according to the second embodiment. As with the web content601, web content901describes a plurality of (three) operation screens created with web content in one web page. Each of the operation screens may be identified by an id element. In addition, JavaScript (trade name) processing for switching attributes for each of the ids is described in <script> (description903) of the web content901. The attribute as used herein means the opacity and the visibility of CSS in this example. In addition, in order to achieve a layer structure, as with the description602of the web content601, the position attribute of CSS for each of the operation screens is specified, in the description902, to the same absolute value. Furthermore, in the description902of the web content901, the visibility attribute and the opacity attribute are described in the attribute of each of the operation screens.

FIGS.7A and7Bare flowcharts used to explain a flow of the processing of the communication terminal100according to the second embodiment. A user who uses the communication terminal100activates an operation screen using application, thereby starting processing of the flowcharts illustrated inFIGS.7A and7B.

Upon activation, by the user, of the operation screen using application using the GUI unit204or the UI unit205, in S1001, the screen display unit304displays an operation type deciding screen on the GUI unit204. The user can use the GUI unit204or the UI unit205to designate either the coordinate operation or the specific operation to be used as an operation type used to operate the operation screens. At this time, information indicating the designated operation type is stored in the memory unit302as operation type information.

In S1002, the communication unit301transmits, to the web server101, a URL at which web content for displaying an operation screen is arranged. In S1003, the communication unit301obtains, from the web server101, the web content corresponding to the URL transmitted in S1002, and stores the web content in the memory unit302. The present embodiment will be described on the assumption that the web content901illustrated inFIGS.6A and6Bis obtained from the web server101. In S1004, the web content analysis unit305analyzes the web content stored in S1004, and the web content rendering unit306renders the web content (three operation screens of UI=01 to 03).

In S1005, the layer switching unit307sets display attributes (visibility and opacity) to a plurality of operation screens in accordance with the operation type designated in S1001. In a case where the coordinate operation is designated, the layer switching unit307sets all the opacity attributes of the plurality of operation screens to visible, and in S1011described later, uses the visibility attribute to individually set visible and invisible of each of the operation screens. On the other hand, in a case where the specific operation is designated, the layer switching unit307sets values of all the visibility attributes of the plurality of operation screens to visible, and in S1012described later, uses the opacity attribute to individually set visible and invisible of each of the operation screens. In the present embodiment, in a case where the coordinate operation is selected in S1001, the layer switching unit307executes a setOpacityforALL( ) processing of the web content901, and sets a value of the opacity attribute of each of the operation screens to “1.” Furthermore, in a case where the specific operation is selected as the operation type in S1001, the layer switching unit307executes a setVisibilityforALL( ) processing of the web content901, and sets a value of the visibility attribute of each of the operation screens to “visible.”

In S1006, the screen display unit304displays the operation screens rendered in S1004on the display screen of the display device211of the GUI unit204. At this time, among the operation screens described in the web content901, the operation screen of id=“ui01” is the only operation screen having a value of the visibility attribute set to “visible” and having a value of the opacity attribute set to “1.” Thus, the display state of the operation screen displayed in S1006is the display state702inFIG.4.

In S1007, the operation detecting unit303detects a user operation to the GUI unit204or the UI unit205, and determines whether or not an instruction is given to switch layers. The determination processing in S1007is similar to that in the first embodiment (S805). In a case where it is determined that the instruction to switch layers is given (YES in S1007), the processing proceeds to S1008. On the other hand, in a case where it is determined that the instruction to switch layers is not given (NO in S1007), the processing proceeds to S1015.

In S1008, the operation detecting unit303determines whether or not the application operation type selected in S1001is identical to an operation type (the coordinate operation or the specific operation) of the operation determined in S1007as the instruction to switch layers. In a case where it is determined that the operation types are identical (YES in S1008), the processing proceeds to S1009, and in a case where it is determined that the operation types are different (NO in S1008), the processing proceeds to S1014. In S1009, the operation detecting unit303notifies the layer switching unit307of operation information determined to be the instruction giving an instruction to switch layers. The processing of S1009is similar to that in the first embodiment (S806). In S1010, the layer switching unit307determines whether the type of operation of the switching instruction is the first operation (coordinate information) or the second operation (specific operation). In a case where the operation type is the coordinate operation (YES in S1010), the processing proceeds to S1011, and in a case where the operation type is the specific operation (NO in S1010), the processing proceeds to S1012.

In S1011, the layer switching unit307performs layer switching processing in accordance with the operation information (information on the coordinate operation) received from the operation detecting unit303. For instance, in a case where the received click=(x, y) corresponds to the region712, the layer switching unit307fires setVisiblityforUI02( ) of the web content901. Through this process, the values of the visibility attributes of id=“ui01” and id=“ui03” of the web content901are set to “hidden,” and the value of the visibility attribute of id=“ui02” is set to “visible.” Furthermore, in the processing of S1011, only the values of the visibility attributes are changed, and the values of the opacity attribute of all the entire screens are kept as “1.” In this manner, the display state702is switched to the display state703, and the screen being displayed is the operation screen701b.

In S1012, the layer switching unit307performs layer switching processing in accordance with the operation information (instruction of processing according to the specific operation) received in S1008. For instance, in a case where the received operation information is run_setOpacityforUI02( ), the layer switching unit307fires setOpacityforUI02( ) of the web content901. At this time, the values of the opacity attributes of id=“ui01” and id=“ui03” of the web content901are “0.” In addition, the value of the opacity attribute of id=“ui02” is “1.” Furthermore, in the processing in S1012, only the value of the opacity attribute is changed, and the value of the visibility attribute is kept as “visible.”

Processing of changing a value of the opacity attribute is faster than processing of changing a value of the visibility attribute, and hence, it is possible to transition operation screens at a higher speed. On the other hand, when “1” is set to values of the visibility attribute in all the operation screens, the operation screen at the upper layer obtains an operation processing in a case where the coordinate operation is performed. Thus, in a case where the coordinate operation is selected, the layer switching unit307changes a value of the visibility attribute to switch operation screens (S1011). For instance, assuming that the coordinate operation is selected in S1001as the application operation type, and a setVIsibilityforALL( ) processing is executed in S1002. At this time, id=“ui01” is the only operation screen having a value of the visibility attribute set to “visible” and a value of the opacity attribute set to “1,” and hence, the screen displayed by the screen display unit304is the operation screen701a. However, all the visibility attributes are set to “visible,” and hence, the operation screen of id=“ui03” at the uppermost layer obtains the operation of the coordinate operation, which makes it impossible to perform an operation to id=“ui01”. This leads to occurrence of unexpected operation for a user depending on the design of the operation screen. In a case of the specific operation, the operation stored in the memory unit302is executed, and thus, it is possible to avoid operating the upper-layer operation screen described above even in a case where a value of the opacity attribute, not a value of the visibility attribute, is changed.

In S1013, the web content analysis unit305analyzes the web content on the basis of the value of attribute changed in S1011or S1012, and the web content rendering unit306renders the web content. And then, the screen display unit304displays rendered content on the display screen of the display device211of the GUI unit204. In the present embodiment, content displayed by the screen display unit304makes transition from the display state702to the display state703inFIG.4. This is because the operation screen, having a value of the visibility attribute set to “visible” and having a value of the opacity attribute set to “1”, is id=“ui02”. In this manner, the displayed operation screen is switched from the operation screen701aof ui01 to the operation screen701bof ui02.

In S1014, the operation detecting unit303performs error notification. The error notification as used herein means notifying that the application operation type selected in S1001and the operation type detected in S1007differ from each other, and thus, an error message may be displayed by the screen display unit304.

In S1015, the operation detecting unit303determines whether or not termination processing is performed. The termination processing represents a case where a user uses the GUI unit204or the UI unit205to terminate the operation screen using application of the communication terminal100. In a case where the termination processing is determined to be performed (YES in S1015), the processing ends. In a case where the termination processing is determined not to be performed (NO in S1015), the processing returns to S1007, and the processing described above is repeated.

With the second embodiment described above, the operation screen using application can be activated with the coordinate operation or the specific operation, and in the specific operation, it is possible to increase the speed of the transition of operation screens faster than the first embodiment.

Furthermore, in the second embodiment, the operation type is decided (S1001) after the operation screen using application is activated, however, the configuration is not limited to this. For instance, an operation type may be decided in accordance with an UI used by a user in giving an instruction to activate an operation screen using application. As a more specific example, in a case where a user operates the touch panel212to activate an operation screen using application, the application operation type is set to the coordinate operation on the assumption that the coordinate operation is continuously used. In contrast, in a case where a button operation of the UI unit205is used to activate an operation screen using application, the application operation type is set to the specific operation.

Third Embodiment

The third embodiment includes, in addition to the first embodiment, performing layer switching processing in accordance with an operation type when the operation detecting unit303receives operation information. More specifically, in a case where the operation type is the coordinate operation, layers (operation screens) are switched by changing the value of Visibility, and in a case where the operation type is the specific operation, layers (operation screens) are switched by changing the value of Opacity. Furthermore, in the third embodiment, the hardware configuration and the software configuration of the communication terminal100, and the system configuration diagram are also identical to those in the first embodiment (FIG.1,FIG.2A, andFIG.2B). In addition, the hardware configuration and the software configuration diagram of the web server101are also identical to those in the first embodiment (FIG.1,FIG.2A, andFIG.2B).

FIGS.8A and8Bare flowcharts used to explain processing of a communication terminal100according to the third embodiment. This flowchart starts upon activation of the operation screen using application by a user who uses the communication terminal100.

In S1101, the communication unit301transmits, to the web server101, a URL at which web content of an operation screen is arranged. In S1102, the communication unit301obtains, from the web server101, the web content corresponding to the URL transmitted in S1101, and stores it in the memory unit302. The present embodiment will be described on the assumption that the web content901(FIGS.6A and6B) is obtained from the web server101. In S1103, the web content analysis unit305analyzes the web content stored in the memory unit302in S1102, and the web content rendering unit306renders the web content on the basis of a result of the analysis. In S1104, the screen display unit304displays content rendered in S1103on the display screen of the GUI unit204. At this time, the displayed content is the display state702inFIG.4. This is because, among the operation screens described in the web content901, id=“ui01” is the only operation screen having a value of the visibility attribute set to “visible” and a value of the opacity attribute set to “1.”

In S1105, the operation detecting unit303determines whether or not an instruction to switch operation screens is given through the coordinate operation from the GUI unit204or the specific operation from the UI unit205. In a case where an operation for switching operation screens through the coordinate operation or the specific operation is detected as a result of determination in S1105(YES in S1105), the processing proceeds to S1106. In a case where the operation to switch operation screens is not detected (NO in S1105), the processing proceeds to S1113. Note that, in order to enable the operation detecting unit303to detect, in S1105, both the operation of switching through the coordinate operation and the operation of switching through the specific operation, the regions711to713are each provided at the same coordinate position between the operation screens701ato701c. This is because the operation of switching through the coordinate operation can be correctly detected even if display is switched only with the opacity attribute.

In S1106, the operation detecting unit303notifies the layer switching unit307of operation information determined to be the instruction giving an instruction to switch layers. In S1107, the layer switching unit307determines, on the basis of the notified operation information, whether or not the operation type is changed. For instance, the layer switching unit307determines whether or not the present operation type indicated by the notified operation information is identical to the previous operation type stored in the memory unit302. In a case where the operation types differ as a result of determination (YES in S1107), the processing proceeds to S1108, and in a case where the operation types are identical (NO in S1107), the processing proceeds to S1109. In addition, in the present embodiment, the previous operation type is stored in the memory unit302at S1108. Thus, the previous operation type for the first time after activation of an application is not stored, however, at this case, the operation type is determined to be changed, and the processing proceeds to S1108.

In S1108, the layer switching unit307performs a preparation processing for switching layers due to the change of operation types. For instance, in a case where the operation type is determined to be changed from the coordinate operation to the specific operation, the layer switching unit307executes processing of setVisibilityforALL( ) of the web content901. In addition, for instance, in a case where the operation type is determined to be changed from the specific operation to the coordinate operation, the layer switching unit307executes processing of setOpacityforALL( ) of the web content901. Furthermore, in S1108, the layer switching unit307updates the previous operation type stored in the memory unit302, with the operation type determined by the operation detecting unit303.

In S1109, the processing branches depending on the detected operation type. In a case where the operation type is the coordinate operation (YES in S1109), the processing proceeds to S1110, and in a case where the operation type is the specific operation (NO in S1109), the processing proceeds to S1111. In S1110, the layer switching unit307performs layer switching processing in accordance with the notified operation information of the coordinate operation. The processing of S1110is similar to that of S1011, and the layer switching unit307changes a value of the Visibility attribute to switch operation screens (layers). On the other hand, in S1111, the layer switching unit307performs layer switching processing in accordance with the notified operation information of the specific operation. The processing of S1111is similar to that of S1012, and the layer switching unit307changes a value of the Opacity attribute to switch operation screens (layers).

In S1112, the web content analysis unit305analyzes the web content on the basis of the value of the attribute changed in S1110or S1111, and the web content rendering unit306renders the web content on the basis of the result of the analysis. Then, the screen display unit304displays the rendered content on the display screen of the GUI unit204. For instance, when an instruction is given through the coordinate operation to make switch into the operation screen of id=2, the value of the opacity attribute is set to “1” for all the layers. In addition, the value of the visibility attribute of a layer of id=2 is set to “visible,” and values of the visibility attribute of other layers are set to “hidden.” Thus, id=“ui02” is the only operation screen (layer) having a value of the visibility attribute set to “visible” and a value of the opacity attribute set to “1,” and the content displayed by the screen display unit304makes transition from the display state702to the display state703inFIG.4.

In S1113, the operation detecting unit303determines whether or not an instruction to perform termination processing is given. The termination processing represents processing performed, for instance, in a case where a user uses the GUI unit204or the UI unit205to terminate the operation screen using application of the communication terminal100. In a case where an instruction to perform the termination processing is determined to be given (YES in S1113), this processing ends. In a case where an instruction to perform the termination processing is determined not to be given (NO in S1113), the processing returns to S1105, and the processing described above is performed.

It should be noted that, in the third embodiment, in a case where switching of operation screens is performed through the coordinate operation, the subsequent input to the operation screen may be performed by either the coordinate operation or the specific operation. On the other hand, in a case where switching of operation screens is performed through the specific operation, the subsequent input to the operation screen is only accepted in a case where the input is performed through the specific operation, except for the instruction to switch operation screens. This is because, in a case of switching of operation screens performed through the specific operation, the values of the visibility attribute of operation screens of all the layers are set to “visible,” and hence, the operation is always detected as the coordinate operation performed to an upper layer. Note that, as described above, the instruction to switch operation screens may be given through either the coordinate operation or the specific operation.

In this manner, according to the third embodiment, it is possible to perform an operation with the coordinate operation even in a case where, after an application using an operation screen is activated, the operation type received by the operation detecting unit303changes while the application is being activated. In addition, in a case where an operation with the specific operation is performed, it is possible to speed up the transition of operation screens, as described in the second embodiment.

It should be noted that, in the first to third embodiments, the web content is arranged on the web server101, however, the configuration is not limited to this. For instance, it may be possible to employ a mode in which web content is arranged in the communication terminal100, and the communication terminal100obtains the web content arranged in the communication terminal100in processing of S801, S1004, and S1101.

Furthermore, in the first to third embodiments, description has been made such that it is possible to reduce the time for transition of the operation screens, in addition to this effect, it is possible to achieve an effect of reducing a processing load of the communication terminal100. This makes it possible to reduce the time in which operations of other applications are interrupted.

According to each of the embodiments described above, it is possible to speed up the transition of UI screens provided by the web page.

Other Embodiments

This application claims the benefit of Japanese Patent Application No. 2022-141515, filed Sep. 6, 2022, which is hereby incorporated by reference herein in its entirety.