INFORMATION DISPLAY APPARATUS, CONTROL METHOD, AND COMPUTER PROGRAM PRODUCT

According to one embodiment, an information display apparatus includes display, link module, input module, detector, determination module, and controller. The display displays a screen. The link module links to an external device, and causes the display to display a screen based on information provided by the external device. The input module receives an input operation with respect to the information display apparatus. The detector detects an operation content received by the input module as a user operation. The determination module compares the user operation and an operation condition corresponding to an operation of each of the external device and the information display apparatus with each other, and determines which of the external device and the information display apparatus is a target device of the user operation. The controller causes the target device determined by the determination module to perform a processing corresponding to the user operation.

DETAILED DESCRIPTION

In general, according to one embodiment, an information display apparatus comprises a display, a link module, an input module, a detector, a determination module, and a controller. The display is configured to display a screen. The link module is configured to link to an external device, and to cause the display to display a screen based on information provided by the external device. The input module is configured to receive an input operation with respect to the information display apparatus. The detector is configured to detect an operation content received by the input module as a user operation. The determination module is configured to compare the user operation and an operation condition corresponding to an operation of each of the external device and the information display apparatus with each other, and to determine which of the external device and the information display apparatus is a target device of the user operation. The controller is configured to cause the target device determined by the determination module to perform a processing corresponding to the user operation.

An information display apparatus, a control method, and a computer program product according to an embodiment will be described below in detail with reference to the accompanying drawings. The embodiment described below is applied to an information display system comprising a television and a tablet terminal, for example.

FIG. 1is an exemplary view of an example of a configuration the information display system according to the embodiment. As illustrated inFIG. 1, the information display system1comprises a television10and one or more tablet terminals20. The television10and the tablet terminal20are communicatively coupled to each other through a network N such as a local area network (LAN) or the Internet, wiredly or wirelessly.

The television10serves as a stationary (floor-standing) information display apparatus such as a television broadcast receiver that receives a digital television broadcast, and a smart television capable of receiving various types of information from the Internet, and displays on a display11various types of content such as a received television program. The television10operates in a linked manner with the tablet terminal20upon a request (link request) from the tablet terminal20.

FIG. 2is a diagram of an example of a hardware configuration of the television10. As illustrated inFIG. 2, the television10comprises the display11, a tuner12, a communication module13, a remote controller communication module14, a storage module15, and a controller16. The television10also comprises a speaker or the like, which is not illustrated.

The display11serves as a display device such as a liquid crystal display (LCD) and an organic light emitting display (OLED), and displays various types of information under the control of the controller16. It should be noted that the display screen of the display11is configured to be larger than the display screen of a display21described later.

The tuner12receives a broadcast signal from a broadcast channel not illustrated through an antenna, for example. Specifically, when a specific channel (i.e., broadcast channel) is specified by a channel selection operation by a user, the tuner12receives a broadcast signal of the specified channel under the control of the controller16.

The communication module13serves as a communication interface that can be connected to the network N. The communication module13transmits and receives various types of information to and from an external device (e.g., the tablet terminal20or a server device not illustrated) coupled to the network N under the control of the controller16.

The remote controller communication module14comprises a receiver comprising an infrared light receiving element or the Bluetooth (registered trademark) technology, for example, and receives a signal transmitted from a remote controller not illustrated. A user of the television10can input various instructions such as to select a channel, to move a focus frame (seeFIG. 5A) for focusing onto an object displayed on the display11, and to move a cursor, using the remote controller.

The storage module15comprises a non-volatile recording medium such as a read only memory (ROM), a hard disk drive (HDD), and a solid state drive (SSD) so as to store therein various computer programs and various types of setting information.

The controller16comprises a central processing unit (CPU) and a random access memory (RAM) (both not illustrated), and entirely controls the operations of the television10by collaborating with a computer program stored in the storage module15. The controller16also implements the functional modules (seeFIG. 4) according to link operations with the tablet terminal20by collaborating with the program stored in the storage module15.

With reference toFIG. 1again, the tablet terminal20serves as a portable information display apparatus which is used in a state in which a user holds the tablet terminal20, and displays various types of information on the display21. The tablet terminal20operates in a linked manner with the television10by transmitting a link request to the television10.

FIG. 3is a diagram of an example of a hardware configuration of the tablet terminal20. As illustrated inFIG. 3, the tablet terminal20comprises the display21, an input module22, a communication module23, a storage module24, and a controller25.

The display21serves as a display device such as a liquid crystal display (LCD) and an organic light emitting display (OLED), and displays various types of information under the control of the controller25.

The input module22serves as an input device such as a pointing device, a button, and a switch, and receives various types of instructions and information that are input by a user. As an example of the pointing device, an optically transparent touch panel that is superimposed on an entire or part of the display surface of the display21is employed in the embodiment, however, the embodiment is not limited thereto. The input device above may employ a sensor device such as a three-axis acceleration sensor capable of sensing a change of an orientation of the tablet terminal20(e.g., rotation or tilt).

The communication module23serves as a communication interface that can be connected to the network N. The communication module23transmits and receives various types of information to and from an external device (e.g., the television10or a server device not illustrated) connected to the network N under the control of the controller25.

The storage module24comprises a non-volatile recording medium such as a ROM, an HDD, and an SSD so as to store therein various computer programs and setting information. An example of setting information stored in the storage module24is an operation determination table241. The operation determination table241will be exemplified later.

The controller25comprises a CPU and a RAM (both not illustrated), and entirely controls the operations of the tablet terminal20by collaborating with a computer program stored in the storage module24. The controller25also implements the functional modules (refer toFIG. 4) corresponding to link operations with the television10by collaborating with a computer program stored in the storage module24.

With reference toFIG. 4, a functional configuration corresponding to a link function between the television10and the tablet terminal20is explained.FIG. 4is a diagram of a functional configuration of the television10and the tablet terminal20.

As illustrated inFIG. 4, the controller16of the television10implements a content obtaining module101, a content display module102, and a link processor103as the functional modules of the television10by collaborating with a computer program stored in the storage module15.

The content obtaining module101obtains data broadcasting contained in broadcast signals received by the tuner12as broadcast content. The content obtaining module101also obtains website content from a server device, not illustrated, by accessing the server device through the communication module13based on a user's operation via the remote controller or access information comprised in an electronic program guide.

The content display module102displays the broadcast content and the website content (collectively referred to as “contents”, hereinafter) obtained by the content obtaining module101on the display11. All or part of the functions of the content obtaining module101and the content display module102may be implemented using a web client program such as a web browser.

The link processor103serves as a functional module, and performs a processing so as to be operated in a linked manner with the tablet terminal20that has accessed the television10. Specifically, when a link request is received from the tablet terminal20through the communication module13, the link processor103temporarily stores identification information comprised in the link request in a RAM and/or the like. The identification information comprises specific information such as: an IP address and a host name that are unique to the television10; and/or version information representing the name and the version of a computer program (application program) that corresponds to implementation of a link processor201, which will be described later.

The link processor103transmits, to the tablet terminal20corresponding to the temporarily stored identification information, application information related to the link with the television10. The link processor103thereby provides the tablet terminal20with an operation environment required for the link to the television10as necessary. The application information comprises a framework and various computer programs (e.g., a script, JAVA (registered trademark), an applet) related to screen displays, or the information to obtain the framework and various computer programs (e.g., a uniform resource locator, URL). If the version information of the link processor201used in the tablet terminal20is comprised in the identification information, the application information corresponding to the version information is transmitted.

After the link with the tablet terminal20is established, the link processor103transmits (provides) display information in which information to be displayed on the tablet terminal20is specified to the tablet terminal20. In other words, the link processor103provides the tablet terminal20with the display information, thereby displaying a screen which is based on the display information on the tablet terminal20. The display information may be image data or video data itself to be displayed on the tablet terminal20, or address information of a server device storing a content of a screen such as an image to be displayed.

The information displayed based on the display information is not limited. For example, information related to the content displayed on the display11by the content display module102may be displayed. This example will be described below with reference toFIGS. 5A and 5B.

FIG. 5Ais a diagram of an example of a display screen displayed on the display11of the television10.FIG. 5Bis a diagram of an example of a display screen displayed on the display21of the tablet terminal20.

In the information display system1, a user watching the television10is present at a position away from the television10, in general. When a plurality of contents are presented on the television10, as illustrated inFIG. 5A, the contents are schematically presented as objects (A11to A16) to increase the visibility of the contents. A screen G11inFIG. 5Aexemplifies outlined explanations for six movies displayed on the display11as the objects A11to A16that can be selected using a focus frame F.

By contrast, a user generally holds the tablet terminal20while using it. The user can therefore recognize small characters on the tablet terminal20more readily than on the television10. This enables designing the screen configuration in the tablet terminal20, taking advantage that more detailed information can be displayed thereon than the television10.

Thus, in the following, it is considered a difference in a viewing mode between the television10and the tablet terminal20, and there is explained a mode in which detailed information for complementing the outlined explanations displayed on the television10is displayed on the tablet terminal20.

Specifically, after the link to the tablet terminal20is established, the link processor103transmits to the tablet terminal20the display information for displaying the detailed information on the object A12on which the focus frame F is disposed out of the objects A11to A16displayed on the display11of the television10. Accordingly, as illustrated inFIG. 5B, in the tablet terminal20, a screen G21representing the detailed information of the object A12is displayed on the display21by the function of the link processor201, which will be described later.

The position of the focus frame F displayed on the display11of the television10can be moved to any direction by operating the remote controller not illustrated. However, the user operating the tablet terminal20has to hold the remote controller of the television10instead of the tablet terminal20to operate the television10. This results in low operability and inconvenience.

Therefore, according to the information display system1of the embodiment, the television10and the tablet terminal20in a link relationship with respect to each other collaborate with each other so that screen operations of the screen displayed on the display11of the television10can be performed from the tablet terminal20. Specifically, in the television10, the screen operation such as to move the focus frame F is performed in accordance with the control information transmitted from the tablet terminal20, as described later. Consequently, seamless operability is provided between the television10and the tablet terminal20. Further, the television10transmits to the tablet terminal20the display information in which the screen operation is reflected. Consequently, a screen which is based on the display information is displayed on the display11.

With reference toFIG. 4again, the controller25of the tablet terminal20collaborates with a computer program stored in the storage module24, thereby implementing the link processor201, an input detector202, and an input determination module203, as the functional module of the tablet terminal20.

The link processor201serves as a functional module and controls the tablet terminal20to operate in a linked manner with the television10. Specifically, the link processor201transmits the link request comprising identification information of the tablet terminal20through the communication module23to the television10, thereby requesting the television10for the link operation with the tablet terminal20.

Once application information is received from the television10in response to transmission of the link request, the link processor201controls operations of the tablet terminal20based on the application information, so as to establish the link to the television10. Then, when display information is received from the television10after the link to the television10is established, the link processor201subsequently displays a screen based on the display information on the display21.

When image data or video data itself is received as the display information, the link processor201causes the display21to display the data by, for example, playing the data. Further, when address information of a server device storing a screen configuration such as an image to be displayed is received as the display information, the link processor201accesses the server device indicated by the address information so as to obtain the contents of the screen from the server device, thereby displaying the screen based on the contents of the screen on the display21. The input detector202and the input determination module203may be implemented by the application information transmitted from the television10.

The input detector202detects a user operation input through the input module22. Specifically, the input detector202obtains a position where the user operation is input through the touch panel (the input module22) as a coordinate value on the display screen of the display21. The input detector202also detects an operation content performed during the touching based on the change in the coordinate value, as a user operation. Examples of the operation content detected are a distance between a coordinate of a starting point and a coordinate of an ending point involved with a tap operation or a flick (slide) operation (hereinafter, referred to as a stroke distance) and a direction of the operation (slide direction).

When a sensor device such as an acceleration sensor is employed as the input module22, a change of an orientation (e.g., rotation or tilt) of the tablet terminal20is detected as the user operation based on the detection result.

The input determination module203determines (identifies) a target device (operation target device) of the user operation detected by the input detector202while linking to the television10based on the operation determination table241stored in the storage module24. The input determination module203causes the operation target device to execute a processing corresponding to the user operation.

FIG. 6is a schematic view of an example of the operation determination table241stored in the storage module24of the tablet terminal20. As illustrated inFIG. 6, the operation determination table241comprises: an operation condition (or operation content) for each operation of the tablet terminal20or the link destination device (the television10); the operation target device (the tablet terminal20or the link destination device); and a processing to be performed by the input determination module203. These are registered in the operation determination table241in association with each other.

FIG. 6illustrates an example in which “stroke distance, point”, “stroke distance, short” and “stroke distance, long” are registered in the operation determination table241as the operation conditions related to the input module22. Here, “Stroke distance, point” means that the stroke distance is zero or within a predetermined minor range. “Stroke distance, short” means that the stroke distance is within a predetermined range of a first length. “Stroke distance, long” means that the stroke distance is within a predetermined range of a second length, which is longer than the first length. As another operation condition relating to the input module22(the acceleration sensor), “rotation” is registered, which means that the tablet terminal20is rotated by a predetermined angle or more while being kept horizontal. “Being kept horizontal” means that the relative angle of the display surface of the display21with respect to a user is maintained almost horizontally.

The input determination module203compares each of the operation conditions registered in the operation determination table241with the user operation detected by the input detector202, and determine (identify) which of the operation conditions registered in the operation determination table241corresponds to the user operation. Once the input determination module203identifies an operation condition corresponding to the user operation, the input determination module203controls the operation target device registered in the table associated with the user operation to perform a processing defined in “operation” associated with the operation target device in the operation determination table241.

For example, when a tap operation is input on a specific GUI (e.g., button B1or B2) on the screen G21displayed on the display21illustrated inFIG. 5B, the input detector202detects the tap operation as the user operation. Then, the input determination module203determines that the user operation detected by the input detector202corresponds to the operation condition “stroke distance, point” based on the operation determination table241inFIG. 6. Subsequently, in accordance with a content of a processing in the operation determination table241, the input determination module203causes the controller25(or the link processor201) to perform a processing for the GUI to which the user operation has been input in the tablet terminal20, i.e., the operation target device.

More specifically, when the tap operation is input on the button B1used for purchasing movie content, the controller25controls the tablet terminal20to perform electronic payment processing or the like corresponding to the purchase of the movie content. Alternatively, when the tap operation is input on the button B2used for previewing the movie content, the controller25causes the tablet terminal20to access a video distribution server, for example, to obtain a preview video of the movie content. It should be noted that some GUIs (buttons) are set in advance associated with a command to be executed or an access destination.

When a stroke operation C1with a stroke distance of the first length to the right direction, as illustrated inFIG. 7A, is input on the screen G21displayed on the display21illustrated inFIG. 5B, the input detector202detects the stroke operation C1as the user operation. In this example, the input determination module203determines that the user operation detected by the input detector202corresponds to the operation condition “stroke distance, short” abased on the operation determination table241inFIG. 6. Subsequently, in accordance with a processing of an operation in the operation determination table241, the input determination module203generates a command for moving the focus frame F (or a cursor) displayed on the display11of the television10to the right direction, which is the same direction as the user operation. The input determination module203then transmits the command to the television10, i.e., the operation target device, as the control information.

When the link processor103of the television10receives the control information from the tablet terminal20, the link processor103executes a processing to move the focus frame F position illustrated inFIG. 5Ato the right direction, in accordance with the command comprised in the control information. This corresponds to a state illustrated inFIG. 7Bin which the focus frame F is arranged on an object A15. Further, the link processor103transmits (provides) display information corresponding to the object A15to which the focus frame F is moved, to the tablet terminal20. Meanwhile, the link processor201of the tablet terminal20displays a screen G22providing detailed information corresponding to the object A15as illustrated inFIG. 7C, on the display21, based on the display information newly provided from the link processor103of the television10.

When a stroke operation C2with a stroke distance of the second length to the left direction, as illustrated inFIG. 8A, is input on the screen G21displayed on the display21illustrated inFIG. 5B, the input detector202detects the stroke operation C1as the user operation. In this example, the input determination module203determines that the user operation detected by the input detector202corresponds to the operation condition “stroke distance, long” based on the operation determination table241inFIG. 6. Subsequently, in accordance with a processing of an operation defined in the operation determination table241, the input determination module203generates a command to move the screen displayed on the display11of the television10to the left direction, which is the same direction as the user operation. The input determination module203then transmits a command to the television10, i.e., the operation target device, as the control information.

When the link processor103of the television10receives the control information from the tablet terminal20, the link processor103executes a processing to move (scroll) the screen illustrated inFIG. 5Ato the left direction, in accordance with the command comprised in the control information. As a result, a screen G12in which objects A21to A26are arranged as illustrated inFIG. 8Bis displayed, for example. Then, the link processor103transmits (provides) the display information corresponding to the object A21on which the focus frame F is arranged in the screen G12. Meanwhile, the link processor201of the tablet terminal20displays a screen G23providing detailed information corresponding to the object A21as illustrated inFIG. 8C, on the display21, based on the display information newly provided from the link processor103of the television10.

The tracks of the stroke operations C1and C2illustrated inFIGS. 7Aor8A only represent the movement of a user's finger or a stylus pen. However, the tracks may actually be displayed on the display21by the input detector202by emphasizing and displaying colors around the pixels corresponding to the stroke position.

Further, when a rotation operation C3is input to the screen G21displayed on the display21as illustrated inFIG. 9while the screen displayed on the tablet terminal20is in the state of the screen G21illustrated inFIG. 5B, the input detector202detects the rotation operation C3as the user operation. Here, the rotation operation C3is an operation such that the horizontally maintained tablet terminal20is rotated to the left direction by a predetermined angle and then brought back to the original state. Further, in this case, the input determination module203determines that the user operation detected by the input detector202corresponds to the operation condition “rotation”, based the operation determination table241inFIG. 6. Subsequently, in accordance with the operation defined in the operation determination table241, the input determination module203generates a command to move the screen displayed on the display11of the television10to the left direction, which is the same direction as the user operation. The input determination module203then transmits the command to the television10, i.e., the operation target device, as the control information. In this example, the same processing is executed as the processing illustrated inFIG. 8Bin the television10, thus the same screen G23illustrated inFIG. 8Cis displayed in the display21of the tablet terminal20.

As described above, with the configuration of the tablet terminal20in the embodiment, it is determined which of the tablet terminal20or the television10is targeted by the user operation input on the tablet terminal20. When the television10is targeted, the television10is controlled to perform the operation (screen operation) corresponding to the user operation. This enables a user of the tablet terminal20to operate the television10without holding the remote controller instead of the tablet terminal20, thereby increasing the operability of the television10and the tablet terminal20.

According to the embodiment, when the operation target device is the television10, a command corresponding to the user operation is generated and transmitted as the control information; however, the embodiment is not limited thereto. The user operation itself (e.g., the stroke distance, the stroke direction, the rotational direction) may be transmitted as the control information, for example.

Further, when the operation target device is the television10, the notification may be performed by, for example, the input determination module203such that the screen displayed on the display21is dimmed or a certain indication representing that the operation is with respect to the television10is displayed on the display21. This enables a user to know which of the television10and the tablet terminal20is targeted by the operation, thereby increasing the convenience of operations on the television10and the tablet terminal20.

The notification may be performed after an operation input on the input module22for the television10is completed or when a predictive operation for the television10is input on the input module22. In other words, the input determination module203may perform the notification when it is determined that an operation for the television10has been input, or alternatively, when, although it cannot yet be determined that an operation for the television10is input, it can be determined that such operation has been input if the input of the operation was continued. For example, with reference to the conditions illustrated inFIG. 6, although the stroke distance is shorter than the length defined for “short” or “long”, i.e., it cannot yet be determined that an operation for the television10has been input, the input determination module203may inform as long as the stroke distance is larger than the length defined for “point”. That is to say, the input determination module203may perform the notification when the operation input to the input module22is excluded from the condition for determining that the operation is input for the tablet terminal20.

The registered contents in the operation determination table241are not limited to the examples illustrated inFIG. 6, and any contents can be set depending on the specifications on the tablet terminal20or the GUI. For example, inFIG. 6, the rotation operation of the tablet terminal20is registered as the operation condition corresponding to the operation for the television10; however, it may be registered as an operation condition corresponding to an operation for the tablet terminal20. Further, the tilt operation in which the tablet terminal20is tilted in the direction perpendicular to the direction (horizontal direction) along the display surface of the tablet terminal20may be registered as an operation condition for the television10or the tablet terminal20. Furthermore, when a touch panel with multi-point detection is used as the input module22, different types of processing may be registered depending on whether the input operation is a single-point input or a multi-point input (e.g., fixing at one point while sliding at another point).

With reference toFIG. 10, operations on the information display system1will now be described.FIG. 10is a flowchart of a link processing performed in the television10and the tablet terminal20. It should be noted that the content obtained by the content obtaining module101is displayed on the display11in the television10, under the control of the content display module102, while this processing is performed.

When the link to the television10is directed by a user operation through the input module22in the tablet terminal20, the link processor201transmits a link request comprising identification information of the tablet terminal20to the television10(S11).

In the television10, once the link processor103receives the link request transmitted from the tablet terminal20, the link processor103temporarily stores the identification information comprised in the link request in a recording medium such as a RAM or the storage module15(S21). The link processor103then transmits application information corresponding to the identification information (comprising the version information) to the tablet terminal20(S22).

In the tablet terminal20, once the link processor201receives the application information transmitted from the television10, the link processor201controls an operation of the tablet terminal20based on the application information (S12). Through the processing (S11, S12, S21, and S22), the link between the television10and the tablet terminal20is established.

After the link is established with respect to the tablet terminal20, the link processor103of the television10transmits display information to the tablet terminal20(S23). Accordingly, the link processor201of the tablet terminal20performs a processing so as to display a screen based on the display information provided from the television10on the display21of the tablet terminal20(S13).

The input detector202of the tablet terminal20waits for the user operation to be detected (No at S14). If an operation is input through the input module22, the input detector202detects the user operation (S14).

The input determination module203compares each of operation conditions registered in the operation determination table241with the user operation detected by the input detector202so as to identify an operation condition corresponding to the user operation (S15). The input determination module203then determines whether the operation target device is the tablet terminal20based on a record of the identified operation condition (S16). If it is determined that the operation target device is the tablet terminal20(Yes at S16), the input determination module203causes the controller25to perform a processing corresponding to the user operation based on the GUI corresponding to the coordinate value at which the user operation is input (S17). Then, the processing returns to S14.

If it is determined that the operation target device is a link destination device (the television10) at S16(No at S16), the input determination module203generates a command corresponding to the user operation (S18). The input determination module203transmits the generated command to the television10as control information (S19). Then, the processing returns to S13.

In the television10, the link processor103waits for the control information to be transmitted from the tablet terminal20(No at S24). If the link processor103receives the control information transmitted from the tablet terminal20(Yes at S24), the link processor103executes the processing corresponding to the command comprised in the control information. This achieves screen operations such as focus movement and screen scroll (S25). The link processor103returns processing to S23so as to transmit the display information reflecting the result of processing at S25to the tablet terminal20.

As described above, according to the embodiment, a user of the tablet terminal20can direct an operation for the television10and the tablet terminal20through the input module22of the tablet terminal20, whereby operability of the tablet terminal20is increased.

The operation (user operation) itself that is input to the tablet terminal20indicates the operation target device, thereby a user only has to input a user operation through the input module22to operate the tablet terminal20and the television10. This eliminates dividing an operation field (touch panel field) for each operation target device, and eliminates a switching operation to switch the operation target device. Consequently, operations are simplified and the operability of the tablet terminal20is increased.

The embodiment described above has been presented by way of example only, and is not intended to limit the scope of the invention. The embodiment described above may be embodied in a variety of other forms; furthermore, various omissions, substitutions, and changes maybe made without departing from the spirit of the invention. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions. The embodiment described above and their modifications are comprised in the scope and abstract of the invention, and also in the invention described in the accompanying claims and the scope of equivalents.

For example, in the above-described embodiment, the information display apparatus of the embodiment is applied to the tablet terminal20. The embodiment, however, may be applied to other information display apparatuses such as a mobile phone or a Smartphone, an operation of which is displayed and performed in user's hand. Also in the above-described embodiment, the television10is employed for a device linking to the tablet terminal20, however, another tablet terminal20comprising the functional modules of the television10may be used.

The computer program executed in the television10and the tablet terminal20according to the embodiment may be provided in a manner recorded as an installable or executable file format in a computer-readable recording medium, such as a compact disk read-only memory (CD-ROM), a flexible disk (FD), a compact disk recordable (CD-R), and a digital versatile disk (DVD).

The computer program executed in the television10and the tablet terminal20according to the embodiment may be provided in a manner stored in a computer connected to a network such as the Internet so as to be downloaded through the network. The computer program executed in the television10and the tablet terminal20according to the embodiment may also be provided or distributed over a network such as the Internet.