Source: https://patents.google.com/patent/JP5869558B2/en
Timestamp: 2020-08-08 04:07:06
Document Index: 353972853

Matched Legal Cases: ['art 102', 'art 100', 'art 100', 'art 103', 'art 100', 'art 102', 'art 101', 'art 102', 'art 103', 'art 104', 'art 105', 'art 106', 'art 108', 'art 109', 'art 110']

JP5869558B2 - Display control apparatus, integrated circuit, display control method, and program - Google Patents
Display control apparatus, integrated circuit, display control method, and program Download PDF
JP5869558B2
JP5869558B2 JP2013510156A JP2013510156A JP5869558B2 JP 5869558 B2 JP5869558 B2 JP 5869558B2 JP 2013510156 A JP2013510156 A JP 2013510156A JP 2013510156 A JP2013510156 A JP 2013510156A JP 5869558 B2 JP5869558 B2 JP 5869558B2
JP2013510156A
JPWO2013057882A1 (en
山内　真樹
2011-10-19 Priority to JP2011229825 priority Critical
2011-10-19 Priority to JP2011229825 priority
2012-09-27 Application filed by パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ, パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ filed Critical パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ
2012-09-27 Priority to PCT/JP2012/006187 priority patent/WO2013057882A1/en
2012-09-27 Priority to JP2013510156A priority patent/JP5869558B2/en
2015-04-02 Publication of JPWO2013057882A1 publication Critical patent/JPWO2013057882A1/en
2016-02-24 Publication of JP5869558B2 publication Critical patent/JP5869558B2/en
238000004590 computer program Methods 0.000 description 16
The present invention relates to a display control device that controls display on a screen of a display unit.
Conventionally, there is a method of controlling a display method of program related information or selecting a viewing mode such as a screen configuration based on a viewing history (see Patent Document 1). Moreover, what determines the viewing mode of an input source based on a user's past viewing history is known (refer patent document 2).
Japanese Patent No. 3747541 Japanese Patent No. 4046994
However, in the conventional configuration, as the number of devices connected to the network increases, information to be pushed (push information) to a display device such as a television, a tablet terminal, or a smartphone that presents information becomes various. Therefore, there is a problem that it becomes difficult to easily select push information of a category that the user desires to select.
The present invention has been made to solve such a problem, and an object of the present invention is to provide a display control device and the like that can display items that are highly likely to be selected by a user.
In order to achieve the above object, a display control apparatus according to an aspect of the present invention is a display control apparatus that controls display of a display unit having a screen, and manages a plurality of items belonging to any of a plurality of categories. Collecting a selection attention history information indicating a history of selection of each of the plurality of categories; A selection operation history collection unit; a selection probability calculation unit that calculates a selection probability that is a probability that the user selects for each of the plurality of categories based on the screen attention level and the selection operation history information; A category having a higher selection probability among a plurality of categories, an item of the category is determined as a display mode that is easy to select, and a display mode determination unit that displays the determined display mode on the display unit; The plurality of categories includes a related category that is a category including items related to the content displayed on the screen, and the selection probability calculation unit is configured to perform the selection when the screen attention level is the first attention level. A selection probability of a related category is calculated to be higher than a selection probability of the related category when the screen attention level is a second attention level lower than the first attention level, and the selection operation history information is obtained for each of the plurality of categories. Is used to calculate the selection probability when the selected number is the first number higher than the selection probability when the selected number is the second number less than the first number.
Note that these comprehensive or specific aspects may be realized by a recording medium such as a method, an integrated circuit, a computer program, or a computer-readable CD-ROM, and the method, the integrated circuit, the computer program, and the recording medium. You may implement | achieve in arbitrary combinations.
The display control device of the present invention can display an item with a high probability of being selected by the user from among a plurality of categories corresponding to a plurality of items.
FIG. 1A is a block diagram illustrating a functional configuration of the display control device according to the embodiment. FIG. 1B is a diagram illustrating a configuration of the display unit. FIG. 2 is a flowchart showing the flow of the display control process. FIG. 3 is a block diagram showing the functional configuration of the display control device in more detail. FIG. 4 is a flowchart showing in detail the flow of the display control process. FIG. 5 is a flowchart showing a detailed flow of processing for calculating the selection probability of each category. FIG. 6A is a diagram for explaining an example of the arrangement of the imaging devices. FIG. 6B is a diagram for describing another example of the arrangement of the imaging devices. FIG. 6C is a diagram for explaining still another example of the arrangement of the imaging devices. FIG. 7 is a flowchart showing the flow of the gaze direction detection process. FIG. 8 is a diagram for explaining processing for detecting the face direction in the gaze direction detection processing. FIG. 9 is a diagram for explaining the calculation of the line-of-sight direction reference plane. FIG. 10 is a diagram for explaining the detection of the center of the black eye. FIG. 11 is a diagram for explaining the detection of the center of the black eye. FIG. 12A is a diagram illustrating an example of the input device. FIG. 12B is a diagram illustrating another example of the input device. FIG. 12C is a diagram illustrating still another example of the input device. FIG. 13A is a diagram illustrating an example of display of push information when the selection probability of related information is the highest. FIG. 13B is a diagram illustrating an example of display of push information when the selection probability of trend information is the highest. FIG. 13C is a diagram illustrating an example of display of push information when the selection probability of notification information is the highest. FIG. 14A is a diagram illustrating another example of display of push information when the selection probability of related information is the highest. FIG. 14B is a diagram for explaining another example of the display of push information when the selection probability of trend information is the highest. FIG. 14C is a diagram illustrating another example of the push information display when the selection probability of the notification information is the highest. FIG. 15A is a diagram illustrating yet another example of the display of push information when the selection probability of related information is the highest. FIG. 15B is a diagram illustrating still another example of the push information display when the selection probability of the trend information is the highest. FIG. 15C is a diagram illustrating still another example of the display of push information when the selection probability of notification information is the highest. FIG. 16A is a diagram illustrating still another example of the display of push information when the selection probability of related information is the highest. FIG. 16B is a diagram illustrating still another example of the display of push information when the selection probability of trend information is the highest. FIG. 16C is a diagram illustrating still another example of display of push information when the selection probability of notification information is the highest. FIG. 17A is a diagram illustrating still another example of the display of push information when the selection probability of related information is the highest. FIG. 17B is a diagram illustrating still another example of the display of push information when the selection probability of trend information is the highest. FIG. 17C is a diagram illustrating still another example of the display of push information when the selection probability of notification information is the highest. FIG. 18A is a diagram illustrating still another example of the display of push information when the selection probability of related information is the highest. FIG. 18B is a diagram illustrating still another example of the display of push information when the selection probability of trend information is the highest. FIG. 18C is a diagram illustrating still another example of the display of push information when the selection probability of notification information is the highest. FIG. 19 is a block diagram illustrating a detailed functional configuration of the display control apparatus according to the first modification. FIG. 20 is a block diagram illustrating a detailed functional configuration of the display control apparatus according to the second modification.
The present inventors have found that the following problems occur with respect to the display control apparatus described in the “Background Art” column.
With the progress of the fusion of broadcasting and communication, televisions are not only used for viewing broadcast contents but also being developed into displays for browsing various information such as web information. In addition, as a new function of television, a function of notifying various information related to life at an appropriate timing has been proposed.
In recent years, network functions of electric devices have become widespread, and a BD (Blu-ray Disc) recorder, a network camera, etc. are linked to a television, and a plurality of devices can be operated with a single remote controller, or a network camera can be displayed on a television screen. It is also possible to check the video.
In addition to these devices, home appliances such as a washing machine, a refrigerator, and a microwave oven can be linked to a television, so that information on each device such as the operating state of each device can be confirmed on the television. That is, a display device such as a television and a plurality of other devices are linked through a network, and information from each device is displayed on the display device, so that the user can go from the display device without having to go close to each device. Information on each device can be referred to.
In the technique of Patent Document 1, the following processing is performed in the program-related information transmission control device on the data distribution side that transmits the program-related information related to each program broadcast to the data receiving side via the data transmission means.
The program-related information transmission control device collects viewing history information obtained according to the viewing operation from the data receiving side. Then, the program related information transmission control device controls the transmission conditions of the program related information of each program based on the viewing history information.
The information processing apparatus of Patent Literature 2 stores a user's past viewing pattern as history information. And when the said information processing apparatus outputs simultaneously the video or audio | voice of the input source provided from several media, based on the said historical information, the viewing format of the input source which suits a user preference is automatically determined. .
However, in the configurations of Patent Documents 1 and 2, as the devices connected to the network increase, information to be pushed (push information) to a display device such as a television, a tablet terminal, or a smartphone that presents information is various. become. Therefore, there is a problem that it becomes difficult to easily select push information of a category that the user desires to select.
In order to solve such a problem, a display control device according to an aspect of the present invention is a display control device that controls display of a display unit having a screen, and a plurality of items belonging to any of a plurality of categories. A management unit that manages the screen, a screen attention level determination unit that determines a screen attention level that is a user's attention level with respect to the screen of the display unit, and selection operation history information that indicates a history of selection of each of the plurality of categories A selection operation history collection unit that collects, a selection probability calculation unit that calculates a selection probability that is a probability that the user selects for each of the plurality of categories based on the screen attention level and the selection operation history information; The category having a higher selection probability among the plurality of categories is determined to be an easily selectable display mode, and the display mode is determined to be displayed on the display unit in the determined display mode. The plurality of categories includes a related category that is a category including items related to the content displayed on the screen, and the selection probability calculation unit is configured such that the screen attention level is the first attention level. Calculating the selection probability of the related category at a higher than the selection probability of the related category when the screen attention level is a second attention level lower than the first attention level, and the selection operation is performed for each of the plurality of categories. Using the history information, the selection probability when the selected number is the first number is calculated to be higher than the selection probability when the selected number is the second number less than the first number.
That is, the display form determination unit sets a category having a higher selection probability among a plurality of categories to an easily selectable display form.
With this configuration, it is possible to easily select an item of a category having a high probability of being selected by the user among a plurality of categories corresponding to the plurality of items. That is, it is possible to provide a display control device that realizes display control that allows easy access to an item of a category that has a high probability of being selected by a user from items of various categories.
That is, the display control device according to one embodiment of the present invention can display items that are highly likely to be selected by the user.
Further, for example, the display control device communicates with at least one electric device, and the plurality of categories include a notification category that is a category including items notified from the electric device, and the display control device includes: And a device operation history collection unit that collects device operation history information indicating a history of operations of the electric device by the user, wherein the selection probability calculation unit further uses the device operation history information to The selection probability of the notification category when the number of times the device has been operated is higher than the selection probability of the notification category when the number of times the device has been operated is the fourth number less than the third number. It may be calculated.
Thereby, based on the user's past operation history, items of the notification category can be displayed in a display form that can be easily selected.
Further, for example, each item of the notification category is associated with an announcement strength indicating the importance of notification of the item to the user, and the selection probability calculation unit is configured to notify the notification category when the announcement strength is the first strength. May be calculated to be higher than the selection probability of the notification category when the announcement strength is the second strength lower than the first strength.
Thus, when the user needs to quickly operate the electric device, the notification category item can be displayed on the display unit in an easily selectable display form. As a result, there is a high possibility that the notification category item is selected by the user.
For example, the item may be push information transmitted from an external device that communicates with the display control device.
Further, for example, the display unit may display content, and the display form determination unit may display the plurality of items superimposed on the content in the determined display form.
Thereby, the user can notice the item displayed on the screen without being disturbed to view the content.
Further, for example, the display form determination unit may display a display form of a category having the maximum selection probability among the plurality of categories, from a display form of a display label of a category other than the category having the maximum selection probability. It may be concrete.
Thereby, the user can easily select an item belonging to the category having the maximum selection probability. In addition, categories other than the category with the highest selection probability are displayed in an abstract manner compared to the category with the highest selection probability, so that the troublesome appearance on the screen is reduced.
Further, for example, the display form determination unit associates the display label of the category with the maximum selection probability with the category and each item belonging to the category, and displays the display label of the category other than the category with the maximum selection probability. , It may correspond to only the category.
Thereby, the user can easily confirm items belonging to the category having the highest selection probability.
Further, for example, the display form determination unit makes the display area of the category item having the maximum selection probability among the plurality of categories larger than the display area of the item of the category other than the category having the maximum selection probability. May be.
Thereby, the user can easily select an item belonging to the category having the maximum selection probability.
Further, for example, the display form determination unit increases the display number of the item of the category having the maximum selection probability among the plurality of categories more than the display number of the item of the category other than the category having the maximum selection probability. May be.
Thereby, the user can easily access items belonging to the category having the maximum selection probability.
Further, for example, the display form determination unit may arrange the display labels of the items of the category having the maximum selection probability and superimpose the display labels of the items other than the category having the maximum selection probability for each category. .
Further, for example, the display form determination unit determines a column including the plurality of items, and sets the column so that the focus position is on the screen with an item of the category having the maximum selection probability as a focus position. The plurality of items may be moved in the column direction.
In addition, for example, the screen attention level determination unit includes a line-of-sight detection unit that detects the user's line-of-sight direction, and the screen attention level determination unit is based on the line-of-sight direction detected by the line-of-sight detection unit. The degree of attention may be determined.
Thereby, for example, when the user's line-of-sight direction is the direction from the user to the screen, it can be determined that the degree of screen attention is high.
In addition, for example, the display unit may display content, and the screen attention level determination unit may determine the screen attention level based on a genre of content displayed on the display unit.
Thus, items that are highly likely to be selected by the user can be displayed based on the genre of the content. For example, when the content genre is drama, the user often pays attention to the screen in order to understand the story of the drama. That is, the degree of screen attention is high. Therefore, in this case, since an item related to the drama is displayed in an easily selectable display form, it is highly possible that the item is selected by a user who is paying attention to the screen in order to understand the story of the drama. On the other hand, for example, when the genre of the content is variety, the user often sees the screen while doing something other than watching the screen, so-called “watching”. That is, the degree of screen attention is low. Therefore, in this case, an item that is not an item related to variety is displayed in a display form that can be easily selected, and thus it is highly possible that the item is selected by the viewing user.
Further, for example, the display unit may display content, and the screen attention level determination unit may determine the screen attention level based on a viewing completion rate of the content displayed on the display unit.
Thereby, for example, when the viewing completion rate is high, the items of the related categories can be displayed in a display form that can be easily selected.
Further, for example, the display control device is operated by an input device for operating the display control device, and the screen attention level determination unit determines the screen attention level based on a user operation on the input device. May be.
Thereby, for example, when the frequency of the user's operation with respect to the input device is high, the item of the related category that is highly likely to be selected by the user can be displayed in an easily selectable display form.
For example, the input device may be a remote controller.
For example, the input device may be a smartphone or a tablet terminal.
For example, the screen attention level determination unit further includes a facial expression determination unit that determines the facial expression of the user, and the screen attention level determination unit is based on the facial expression of the user determined by the facial expression determination unit. The screen attention degree may be determined.
Thereby, for example, when the user's facial expression determined by the facial expression determination unit is a smile, it is possible to display items of related categories that are highly likely to be selected by the user in a display form that can be easily selected.
In addition, for example, the screen attention level determination unit further includes a voice acquisition unit that acquires voice, and the screen attention level determination unit includes the content of the user's conversation acquired as voice by the voice acquisition unit. The screen attention degree may be determined based on the above.
Thereby, for example, when a laughter is included in the content of the conversation, it is possible to display items of related categories that are highly likely to be selected by the user in a display form that can be easily selected.
In addition, for example, the screen attention level determination unit further includes a voice acquisition unit that acquires voice, and the screen attention level determination unit acquires the degree of excitement of the user's conversation acquired as voice by the voice acquisition unit. The screen attention degree may be determined based on the above.
Thus, for example, when the conversation volume is greater than a predetermined value for a predetermined time or more, it is determined that the conversation excitement level is high, and when the conversation excitement level is high, it can be selected by the user. It is possible to display items of related categories having high characteristics in an easily selectable display form.
In addition, for example, the display control device further includes a user identification unit that identifies a user located in front of the screen of the display unit, and the screen attention determination unit further includes a list of friends of the user and the user A friend information acquisition unit that acquires content viewing information indicating content viewed by a friend is included, and the screen attention determination unit includes a large number of friends who are viewing the same content as the content displayed on the display unit. It may be determined that the degree of screen attention is higher.
As a result, as the number of friends who are viewing the same content as the content displayed on the display unit increases, that is, as the content swells among friends, the related category items can be easily selected. Is displayed. Since it is estimated that the content that is exciting among the user's friends is also highly interested in the user, there is a high possibility that the item of the related category is selected. That is, when there are a large number of friends viewing the same content, items that are likely to be selected by the user can be displayed in an easily selectable display form.
For example, the screen attention level determination unit further includes a recommender acquisition unit that acquires information indicating a recommender of the content displayed on the display unit, and the screen attention level determination unit includes the display unit. It may be determined that the higher the ranking of the recommenders of the content displayed in is, the higher the screen attention is.
As a result, the higher the rank of the recommender of the content displayed on the display unit, the more easily the items of the related category are displayed. Since the content recommended by the recommender having a high rank is estimated to be useful to the user, there is a high possibility that the item of the related category is selected. That is, it is possible to display items related to the content recommended by recommenders with high rankings in a display form that can be easily selected.
Further, for example, the order of the recommenders may be higher as the total number of votes by viewers within a predetermined range increases.
As a result, the items recommended by the recommender who has a large total number of votes by viewers within a predetermined range can be displayed in a display form that is easy to select. For example, in the case where viewers with similar preferences to the user are set in a predetermined range, items that meet the user's preference can be displayed in a display form that can be easily selected.
Note that these comprehensive or specific aspects may be realized by a recording medium recording medium such as a method, an integrated circuit, a computer program, or a computer-readable CD-ROM, and the method, integrated circuit, computer program, or recording. You may implement | achieve in arbitrary combinations of a medium.
It should be noted that each of the embodiments described below shows a comprehensive or specific example. Numerical values, shapes, constituent elements, arrangement positions of constituent elements, steps, order of steps, and the like shown in the following embodiments are merely examples, and are not intended to limit the present invention. In addition, among the constituent elements in the following embodiments, constituent elements that are not described in the independent claims indicating the highest concept are described as optional constituent elements.
Moreover, in the following description, the same code | symbol is attached | subjected to the same component. Their names and functions are also the same. Therefore, detailed description thereof may be omitted.
FIG. 1A is a block diagram showing a functional configuration of display control apparatus 1000 according to the present embodiment. FIG. 1A shows main components in the display control apparatus 1000.
The display control apparatus 1000 is a television. The display control apparatus 1000 is not limited to a television, and may be another apparatus as long as it can display an image. For example, the display control apparatus 1000 may be a tablet terminal or a smartphone. In this specification, it is assumed that content is video content.
As illustrated in FIG. 1A, the display control apparatus 1000 includes a display unit 100, a push information management unit 101, an involvement degree determination unit 110, a selection probability calculation unit 108, and a display form determination unit 109.
The display unit 100 is, for example, an LCD (Liquid Crystal Display), and displays content (video).
FIG. 1B is a diagram illustrating a configuration of the display unit 100. The display unit 100 has a screen 100a. Content (video) or the like is displayed on the screen 100a.
The display unit 100 is not limited to the LCD, and may be a PDP (Plasma Display Panel) or an organic EL display (OLED: Organic Light Emitting Display). Further, the display unit 100 may be realized by a configuration in which a projector projects onto a surface such as a wall.
The push information management unit 101 acquires push information, details of which will be described later. Push information is information distributed by a known push type technology. Push information belongs to one of a plurality of categories. The plurality of categories are categories of information such as trend information, related information, and notification information, for example. Hereinafter, a category to which trend information belongs may be described as a trend category, a category to which related information belongs, a related category, and a category to which notification information belongs, as a notification category.
The trend information is information that has become a hot topic in, for example, society and regions. The related information is information related to the content (video content) displayed on the display unit 100. Although the details will be described later, the notification information is information transmitted from an electric device described later.
The push information management unit 101 acquires, for example, push information distributed by a push information providing apparatus (not shown) via a network, a broadcast network, or the like. The push information providing apparatus is, for example, a server. In addition, the push information management unit 101 acquires push information transmitted by the electrical device 301 described later.
Note that the push information management unit 101 may acquire push information included in content acquired by the display control apparatus 1000 from the outside.
Further, the push information management unit 101 manages a plurality of acquired push information belonging to any of a plurality of categories.
The degree of participation determination unit 110 calculates the degree of participation between the user and push information belonging to each category.
Although details will be described later, the selection probability calculation unit 108 calculates a selection probability that is a probability that the user selects each of a plurality of categories corresponding to a plurality of push information.
Although the details will be described later, the display form determination unit 109 makes the push information of the category more easily selectable (easy to access) as the category has a higher selection probability among the plurality of categories corresponding to the plurality of push information. Set.
Next, various operations in the display control apparatus 1000 shown in FIG. 1A will be briefly described.
FIG. 2 is a flowchart showing the flow of display control processing in the present embodiment.
First, the push information management unit 101 acquires a plurality of push information (S101). Then, the participation degree determination unit 110 calculates the participation degree between the user and the push information belonging to each category (S102). Next, the participation degree determination unit 110 calculates the selection probability of each category corresponding to the plurality of push information based on the calculated participation degree (S103). The display form determination unit 109 determines the display form of the push information belonging to each category based on the calculated selection probability (S104).
FIG. 3 is a block diagram showing in more detail the functional configuration of the display control apparatus 1000 according to the present embodiment.
The display control device 1000 is operated by the input device 10 by wireless communication or the like. The input device 10 is a device for operating the display control device 1000. The input device 10 is a remote controller. In addition, the input device 10 is not limited to a remote control, For example, mobile terminals, such as a smart phone or a tablet terminal, may be sufficient. In FIG. 3, the display control device 1000 and the input device 10 are described as separate devices, but the display control device 1000 may have the function of the input device 10 as a matter of course. For example, when a tablet terminal or a smartphone is the display control apparatus 1000, the tablet terminal or the smartphone may also have the function of the input device 10.
The display control apparatus 1000 communicates with at least one electric device 301. Specifically, as shown in FIG. 3, the display control apparatus 1000 is connected to one or a plurality of electric devices 301 via a network. The network is a wired network using a LAN cable or the like, or a wireless network using a wireless LAN.
The electric device 301 is a network home appliance such as a washing machine, a refrigerator, an air conditioner, an air purifier, a microwave oven, and a BD recorder.
The electric device 301 transmits device operation history information indicating a history of user operations on the electric device 301 to the display control apparatus 1000.
In addition, the electrical device 301 transmits push information whose category is notification information to the push information management unit 101. That is, the electric device 301 is a source device that transmits notification information. In this case, the push information is information indicating, for example, the operating state of the electrical device 301.
Here, it is assumed that the electric device 301 is a washing machine, for example. In this case, push information is information for notifying that washing was completed, for example.
The display control apparatus 1000 further includes a user identification unit 102 and a screen attention level determination unit 103.
The user identification unit 102 acquires an image indicating the subject imaged by the imaging device (camera) 200 from the imaging device 200. Hereinafter, an image obtained by imaging by the imaging device 200 is also referred to as a captured image.
Although details will be described later, the user identification unit 102 identifies a user in front of the screen 100a of the display unit 100 using a captured image. In addition, you may identify a user using the mobile terminal which each user owns.
Although details will be described later, the screen attention level determination unit 103 determines the screen attention level that is the attention level of the identified user with respect to the screen 100 a of the display unit 100.
The participation degree determination unit 110 includes a selection operation history collection unit 104, a device operation history collection unit 105, and an operation history storage unit 106.
The selection operation history collection unit 104 collects selection operation history information indicating a history of a category selected by the user using the input device 10 or the like among a plurality of categories corresponding to a plurality of push information. For example, the selection operation history information indicates a history in which a category called notification information is selected from a plurality of categories corresponding to a plurality of push information. Then, the selection operation history collection unit 104 stores the collected selection operation history information in the operation history storage unit 106.
The device operation history collection unit 105 collects the device operation history information described above from each electric device 301. Then, the device operation history collection unit 105 stores the collected device operation history information in the operation history storage unit 106.
The operation history storage unit 106 stores (stores) selected operation history information and device operation history information.
Next, various operations in the display control apparatus 1000 configured as shown in FIG. 3 will be described.
FIG. 4 is a flowchart showing in detail the flow of display control processing in the present embodiment. Here, it is assumed that a user exists in front of the screen 100a of the display unit 100. In this case, the captured image indicates a user.
First, the push information management unit 101 acquires a plurality of push information (S201). Then, the user identification unit 102 acquires a captured image indicating the user from the imaging device 200. The user identifying unit 102 identifies the user by a known face recognition process, for example, by matching the user's face indicated by the acquired captured image with face information registered in the database in advance. That is, the user identification part 102 identifies the user who exists ahead of the screen 100a of the display part 100 (S202).
Subsequently, the selection probability calculation unit 108 acquires the above-described selection operation history information corresponding to the identified user stored in the operation history storage unit 106 (S203). In addition, the selection probability calculation unit 108 acquires the above-described device operation history information corresponding to the identified user stored in the operation history storage unit 106 (S204).
Subsequently, the screen attention level determination unit 103 determines the screen attention level, as will be described in detail later (S205). The screen attention level determination unit 103 transmits the determined screen attention level to the selection probability calculation unit 108. Thereby, the selection probability calculation unit 108 acquires the screen attention level.
Then, the selection probability calculation unit 108 determines the selection probability of each category based on the acquired screen attention level and selection operation history information corresponding to the plurality of push information (S206). Specifically, the selection probability calculation unit 108 selects the selection history information acquired in the process of acquiring selection operation history information (S203) and the device operation history information acquired in the process of acquiring device operation history information (S204). And the selection probability of each category is calculated based on the screen attention level determined in the process (S205) of determining the screen attention level.
The detailed process in the process of calculating the selection probability of each category (S206) will be described later. For example, the selection probability calculation unit 108 has a category with a small screen attention level and the selection operation history information is a notification information. When the number of times of selection indicates that the number is greater than or equal to a predetermined number, the selection probability of the category of notification information is calculated to be high.
The selection probability calculation unit 108 may calculate the selection probability based on the acquired screen attention level, device operation history information, and selection operation history information.
Here, it is assumed that the acquired screen attention degree is equal to or less than a predetermined value. Further, it is assumed that the acquired device operation history information indicates that the electric device 301 corresponding to the device operation history information has not been operated for a predetermined number of days or more. In this case, the selection probability calculation unit 108 calculates, for example, the highest selection probability of the category called “trend” among the plurality of categories corresponding to the plurality of push information.
Next, the selection probability calculation unit 108 transmits the calculated selection probability to the display form determination unit 109. Thereby, the display form determination unit 109 acquires the selection probability. The display form determination unit 109 determines the display form of the push information belonging to each category based on the acquired selection probability (S207). In other words, for a category with a higher selection probability, push information belonging to that category is determined as a display form that can be easily selected, and displayed on the display unit 100 in the determined display form.
Then, the display form determination unit 109 controls the display unit 100 so that the display unit 100 displays the push information in the determined display form. Thereby, the display part 100 displays push information of the determined display form.
For example, according to the display form determined by the process of determining the display form (step S207), the display form determining unit 109 pushes the category having the maximum selection probability among the plurality of categories corresponding to the plurality of push information. The display unit 100 is controlled to display an information display area larger than a push information display area of a category other than the category having the maximum selection probability.
As described above, the display control apparatus 1000 according to the present embodiment is a display control apparatus that controls the display of the display unit 100 having a screen, and manages a plurality of push information belonging to any of a plurality of categories. Push information management unit 101, screen attention level determination unit 103 that determines a screen attention level that is a user's attention level with respect to the screen of display unit 100, and selection operation history information that indicates a history of selection of each of a plurality of categories. A selection operation history collection unit 104 to collect, a selection probability calculation unit 108 that calculates a selection probability, which is a probability that the user selects, for each of a plurality of categories based on the screen attention level and the selection operation history information; The category having a higher selection probability is determined as a display form in which the push information of the category can be easily selected, and is displayed on the display unit 100 in the determined display form. A plurality of categories including related information that is a category of push information related to the content displayed on the screen, and the selection probability calculating unit 108 has a screen attention degree of the first level. The selection probability of the related category in the case of one attention level is calculated to be higher than the selection probability of the related category in the case of the second attention level where the screen attention level is lower than the first attention level, and the selection operation history for each of the plurality of categories Using the information, the selection probability when the selected number is the first number is calculated higher than the selection probability when the selected number is the second number less than the first number.
Thereby, display control apparatus 1000 according to the present embodiment can easily select push information of a category having a high probability of being selected by the user among a plurality of categories corresponding to the plurality of push information. That is, the display control apparatus 1000 according to the present embodiment realizes display control that allows easy access to push information of a category that has a high probability of being selected by a user from push information of a variety of categories. That is, the display control apparatus 1000 can display push information that is highly likely to be selected by the user.
[Screen attention level judgment processing]
Next, a detailed operation of the display control apparatus 1000 described above will be described.
First, of the processes included in the display control process of FIG. 4, the process of determining the screen attention level (step S205) will be described in detail.
The screen attention level determination unit 103 determines the screen attention level based on the user's gaze direction detected by the gaze detection unit 111 described later. The user is a user identified by the user identifying unit 102 in the process of identifying the user (step S202).
Specifically, for example, the screen attention level determination unit 103 determines that the screen attention level is higher (larger) as the time during which the screen attention state continues is longer. The screen attention state is a state in which a user's line-of-sight direction detected by a process (S509) described later is a direction from the user to the screen 100a of the display unit 100. That is, the screen attention state is a state in which the user is looking at any region of the screen 100a.
[Selection probability calculation process]
Next, among the processes included in the display control process of FIG. 4, the process of calculating the selection probability of each category (S206) will be described in detail.
FIG. 5 is a flowchart showing a detailed process flow in the process (S206) of calculating the selection probability of each category.
First, the selection probability calculation unit 108 determines whether or not the screen attention level determined in the process of determining the screen attention level (S205) is high (S301). Here, “the screen attention level is high” indicates, for example, a case where the screen attention state per unit time is 80% or more.
When it is determined that the degree of screen attention is high (Yes in S301), the selection probability calculation unit 108 increases the selection probability of related information (S302). That is, when the user is watching the screen 100a in a concentrated manner, that is, when the user is interested in the content displayed on the screen 100a, the selection probability of related information that is a category of push information related to the content. To increase.
Next, after the process of increasing the selection probability of related information (S302) and when it is determined that the screen attention level is not high (No in S301), the selection probability calculation unit 108 stores the operation history storage unit 106 in the operation history storage unit 106. It is determined from the stored selection operation history information whether the number of times of selection is large for each category (S303). Here, “the number of selected times is large” means that the selected number of times exceeds a predetermined threshold (for example, 10 times).
When it is determined that the number of selected times is large (Yes in S303), the selection probability calculating unit 108 increases the selection probability of the category determined as having a large number of selected times (S304). Note that the selection probability calculation unit 108 uses the selection operation history information when the number of times selected per unit time (for example, the previous three days) exceeds a predetermined number of times (for example, 5 times). The selection probability may be increased. Moreover, you may make the selection probability of the said category high, so that the selected frequency is high.
Next, after the process of increasing the selection probability of a category having a large number of selected times (S304) and when it is determined that the number of selected times of each category is not large (No in S304), a selection probability calculating unit 108 determines from the device operation history information stored in the operation history storage unit 106 whether the number of times each electric device 301 has been operated is large (S305). Here, “the number of times of operation is large” means that the number of times each electric device 301 is operated exceeds a predetermined threshold (for example, 10 times).
If it is determined that the number of operations has been large (Yes in S305), the selection probability calculation unit 108 increases the selection probability of the notification information (S306). Note that the selection probability calculation unit 108 uses the operation history information to notify the notification information when the number of times selected per unit time (for example, the immediately preceding day) exceeds a predetermined number of times (for example, once). The selection probability may be increased. Moreover, when there exists the electric equipment 301 with the operated high frequency, you may make the selection probability of notification information high, and you may make the selection probability of notification information high, so that the frequency is high.
The above process is a detailed process of the process (S206) of calculating the selection probability of each category. Thus, the selection probability calculation unit 108 calculates the selection probability of the related information when the screen attention level is high, higher than the selection probability of the related information when the screen attention level is low, and each of the selection operation history information indicates The selection probability of each category when the number of times of category selection is large is calculated to be higher than the selection probability of each category when the number of selections is small. Note that “when the screen attention level is high” is an example of “when the screen attention level is the first attention level” in the present invention, and “when the screen attention level is low” indicates that the screen attention level according to the present invention is “ This is an example of “second attention degree”. Further, “when the number of times of selection is large” is an example of “when the number of times of selection is the first number” in the present invention, and “when the number of times of selection is small” is the case where the number of times of selection according to the present invention is “first”. This is an example of “in the case of two times”.
The display control apparatus 1000 communicates with at least one electric device 301, and the plurality of categories includes a notification category that is a category including items notified from the electric device 301. The display control apparatus 1000 further includes: A device operation history collection unit 105 that collects device operation history information indicating a history of operations of the electric device 301 by the user is provided, and the selection probability calculation unit 108 further operates the electric device 301 indicated by the device operation history information. The notification category selection probability when the number of notifications is large is calculated to be higher than the notification category selection probability when the screen attention level is low. Note that “the number of times of operation is large” is an example of “when the number of times of operation is the third number” in the present invention, and “when the number of operations is small” is an example of the operation in the present invention. This is an example of “the fourth number”.
Thereby, when the screen attention degree is high, the selection probability calculation unit 108 increases the selection probability of related information that is a category including push information related to the content displayed on the screen 100a, and the number of times of selection is increased. When there are many categories, the selection probability of the category (for example, trend information) can be increased, and when the number of device operations is large, the selection probability of the notification category including the push information transmitted from the electric device 301 can be increased. Therefore, the display control apparatus 1000 according to the present embodiment displays the display unit in a display mode in which a plurality of push information items in a category having a higher selection probability is easily selected in the subsequent process of determining a display mode (S207). By displaying on 100, push information that is highly likely to be selected by the user can be displayed.
In the above, the screen attention level is high when the screen attention level per unit time is 80% or more. However, the screen attention level is not limited to this, and the screen attention level per unit time is not limited to this. May be 50% or more, or the screen attention state per unit time may be 90% or more.
The selection probability calculation unit 108 may calculate the selection probability of related information higher as the screen attention degree is higher. For example, when the screen attention level is directly proportional to the ratio of the screen attention state per unit time, the higher the screen attention state, the higher the selection probability of the related information may be calculated.
In addition, the selection probability calculation unit 108 may calculate a higher selection probability for a category with a larger number of selections indicated by the selection operation history information. For example, when the trend information is selected 3 times, the related information is selected 15 times, and the notification information is selected 10 times, the selection probability calculation unit 108 selects the related information, the notification information, and You may calculate a selection probability high in order of trend information. Similarly, the greater the number of operations indicated by the device operation history information, the higher the notification category selection probability may be calculated.
Further, the selection probability calculation unit 108 calculates the number of times selected per unit time from the number of times selected indicated by the selection operation history information, and selects a category having a larger number of times selected per unit time. The probability may be calculated high. That is, the higher the selection probability, the higher the selection probability may be calculated. Similarly, the number of operations per unit time is calculated from the number of operations indicated by the device operation history information, and the higher the calculated number of operations per unit time, the higher the notification category selection probability. May be.
In addition, the selection probability calculation unit 108 uses the number of times each electric device 301 indicated by the device operation history information is operated, and push information transmitted from the electric device 301 having a larger number of operations increases the selection probability. It may be calculated.
In addition, each push information belonging to the notification category is associated with the announcement strength of the push information, and the selection probability calculation unit 108 notifies when the announcement strength of the push information acquired by the push information management unit 101 is the first strength. The category selection probability may be calculated to be higher than the notification category selection probability in the case where the announcement strength of the push information is the second strength lower than the first strength. Here, the announcement strength of push information corresponds to, for example, the degree of requesting a response from the user. For example, when the electric device 301 is a microwave oven and the push information of the microwave oven is the end of heating, the announcement strength is that the electric device 301 is an air cleaner and the push information of the air cleaner is the operation end It is higher than the announcement strength in the case of. Further, for example, the first intensity may be an intensity equal to or higher than a predetermined threshold, and the second intensity may be an intensity less than the threshold. In addition, the selection probability calculation unit 108 may calculate the notification category selection probability higher as the announcement strength of the push information is higher.
As a result, when the user needs to quickly operate the electrical device 301, the push information of the notification information can be displayed on the screen 100a in an easily selectable display form. Therefore, the push information of the notification information is selected by the user. Is more likely.
The selection probability calculation unit 108 also calculates the selection probability of the related information calculated based on the degree of screen attention, the selection probability of each category calculated based on the selection operation history information, and the notification calculated based on the device operation history information. You may calculate the selection probability of each category obtained by weighting each of the category selection probabilities. That is, for example, the largest weight may be given to the selection probability of the related information calculated based on the screen attention degree, and the smallest weight may be given to the selection probability of each category calculated based on the selection operation history information. In this case, when the category with a high screen attention level, a large number of operations indicated by the device operation history information, and a large number of selected times indicated by the selection history information is only trend information, the selection probability calculation unit 108 The selection probability finally calculated becomes smaller in the order of related information, notification information, and trend information.
Further, the final selection probability of each category may be calculated by simple addition without performing the above weighting.
[Detection processing of user's gaze direction]
Next, processing for detecting the user's line-of-sight direction will be described in detail.
The screen attention level determination unit 103 includes a line-of-sight detection unit 111 that detects the line-of-sight direction of the user identified by the user identification unit 102. Details of the gaze direction detection processing for detecting the gaze direction of the gaze detection unit 111 are as follows.
The line-of-sight direction is based on a combination of the direction of the user's face (hereinafter referred to as “face direction”) and the direction of the black eye portion in the eye relative to the user's face direction (hereinafter referred to as “black eye direction”). Calculated. Therefore, the line-of-sight detection unit 111 first estimates the three-dimensional face orientation of the person. Next, the gaze detection unit 111 estimates the black eye direction. Finally, the gaze detection unit 111 calculates the gaze direction by integrating the face direction and the black eye direction.
Note that the line-of-sight detection unit 111 does not necessarily calculate the line-of-sight direction based on the combination of the face direction and the black-eye direction. For example, the line-of-sight detection unit 111 may calculate the line-of-sight direction based on the center of the eyeball and the center of the iris (black eye). That is, the line-of-sight detection unit 111 may calculate a three-dimensional vector connecting the three-dimensional position of the eyeball center and the three-dimensional position of the iris (black eye) center as the line-of-sight direction.
6A, 6B, and 6C are diagrams illustrating an arrangement of the imaging device 200 that captures an image acquired in the line-of-sight direction detection process according to the present embodiment. As illustrated in FIG. 6A, FIG. 6B, and FIG. 6C, the imaging device 200 is installed in the vicinity of the screen 100 a so that the user facing the screen 100 a of the display unit 100 can be imaged. For example, the imaging apparatus 200 is disposed on the upper part of the display unit 100 as illustrated in FIG. 6A. In addition, as illustrated in FIG. 6B or 6C, the imaging device 200 may be disposed at a position away from the display unit 100.
FIG. 7 is a flowchart showing the flow of gaze direction detection processing in the present embodiment.
First, the line-of-sight detection unit 111 acquires, from the imaging device 200, an image obtained by imaging the user whose imaging device 200 exists in front of the screen 100a of the screen 100a (opposite the screen 100a) (S501). Subsequently, the line-of-sight detection unit 111 detects a face area from the acquired image (S502). Next, the line-of-sight detection unit 111 applies the face part feature point areas corresponding to the respective reference face orientations to the detected face area, and cuts out the area image of each face part feature point (S503).
The line-of-sight detection unit 111 calculates the degree of correlation between the clipped region image and the template image held in advance (S504). Subsequently, the line-of-sight detection unit 111 obtains an angle indicated by each reference face direction from a weighted sum obtained by weighting and adding according to the calculated ratio of correlation degrees, and the user's face corresponding to the detected face area The direction is detected (S505).
FIG. 8 is a diagram for explaining in detail the process (S505) of detecting the face direction in the gaze direction detection process in the present embodiment.
As shown in FIG. 8A, the line-of-sight detection unit 111 stores the facial part feature points from the facial part region DB (database) 112 that stores the facial part feature point areas corresponding to each reference face direction. Read the area. Subsequently, as shown in FIG. 8B, the line-of-sight detection unit 111 applies the facial part feature point area to the face area of the photographed image for each reference face direction, and the facial part feature point area image. For each reference face orientation.
Then, as shown in FIG. 8C, the line-of-sight detection unit 111 determines the correlation degree between the clipped region image and the template image held in the face part region template DB (database) 113 for each reference face direction. To calculate. In addition, the line-of-sight detection unit 111 calculates a weight for each reference face direction in accordance with the high degree of correlation indicated by the calculated degree of correlation. For example, the line-of-sight detection unit 111 calculates, as a weight, the ratio of the correlation degree of each reference face direction to the sum of the correlation degrees of the reference face direction.
Subsequently, as shown in FIG. 8D, the line-of-sight detection unit 111 calculates the sum of values obtained by multiplying the angle indicated by the reference face direction by the calculated weight, and sets the calculation result as the user's face direction. To detect.
In the example of FIG. 8D, the weight for the reference face direction +20 degrees is “0.85”, the weight for the front direction is “0.14”, and the weight for −20 degrees is “0.01”. The line-of-sight detection unit 111 detects the face orientation as 16.8 degrees (= 20 × 0.85 + 0 × 0.14 + (− 20) × 0.01).
In the present embodiment, the line-of-sight detection unit 111 calculates the degree of correlation for the facial part feature point region image, but the present invention is not limited to this. For example, the line-of-sight detection unit 111 may calculate the degree of correlation for an image of the entire face area.
As another method for detecting the face orientation, a method may be used in which facial part feature points such as eyes, nose and mouth are detected from the face image, and the face orientation is calculated from the positional relationship of the facial part feature points. .
As a method of calculating the face direction from the positional relationship of the facial part feature points, a three-dimensional model of facial part feature points prepared in advance is rotated and matched so as to best match the facial part feature points obtained from one camera. There is a method of performing matching by enlarging / reducing and calculating the face direction from the rotation amount of the obtained three-dimensional model, and this method may be used.
Further, as another method for calculating the face orientation from the positional relationship between the facial part feature points, the facial part feature point positions in the left and right cameras using the principle of stereo vision based on images taken by two cameras. There is a method of calculating the three-dimensional position of each facial part feature point from the deviation on the image and calculating the face direction from the positional relationship of the obtained facial part feature points. Specifically, for example, there is a method of detecting the normal direction of the plane stretched by the three-dimensional coordinate points of both eyes and mouth as the face direction. Such a method may be used as a method of detecting the face orientation.
The line-of-sight detection unit 111 detects the three-dimensional positions of the left and right eyes of the user using the stereo image captured by the imaging device 200, and calculates the reference direction of the line-of-sight using the detected three-dimensional positions of the left and right eyes. (S506). Subsequently, the line-of-sight detection unit 111 detects the three-dimensional position of the center of the left and right eyes of the user using the stereo image captured by the imaging device 200 (S507). Then, the line-of-sight detection unit 111 detects the black-eye direction using the line-of-sight direction reference plane and the three-dimensional position of the left and right black-eye centers (S508).
Then, the line-of-sight detection unit 111 detects the user's line-of-sight direction using the detected face direction and black-eye direction of the user (S509).
Next, details of a method of detecting the black eye direction will be described with reference to FIGS.
In the present embodiment, the gaze detection unit 111 first calculates a gaze direction reference plane. Subsequently, the line-of-sight detection unit 111 detects the three-dimensional position of the center of the black eye. Finally, the line-of-sight detection unit 111 detects the black eye direction.
FIG. 9 is a diagram for explaining the calculation of the line-of-sight direction reference plane in the present embodiment.
The line-of-sight direction reference plane is a plane that serves as a reference when detecting the black eye direction, and is the same as the left-right symmetric plane of the face as shown in FIG. It should be noted that the position of the eyes is less affected by facial expressions and less erroneously detected than other facial parts such as the corners of the eyes, mouth corners, or eyebrows. Therefore, the line-of-sight detection unit 111 calculates the line-of-sight reference plane, which is a symmetrical plane of the face, using the three-dimensional position of the eye.
Specifically, the line-of-sight detection unit 111 uses a face detection module and a face part detection module in each of two images (stereo images) captured by a stereo camera that is the imaging device 200, and uses the face detection module and the right eye region. Is detected. Then, the line-of-sight detection unit 111 measures the three-dimensional position of each of the left and right eyes using the detected positional deviation (parallax) between the images of the eye areas. Further, the line-of-sight detection unit 111 calculates, as the line-of-sight direction reference plane, a vertical bisector having a line segment whose end point is the detected three-dimensional position of the left and right eyes as shown in FIG.
10 and 11 are diagrams for explaining the detection of the center of the black eye in the present embodiment.
The light from the object reaches the retina through the pupil, is converted into an electrical signal, and the electrical signal is transmitted to the brain, so that the person visually recognizes the object. Therefore, the line-of-sight direction can be detected using the position of the pupil. However, since the Japanese iris is black or brown, it is difficult to discriminate between the pupil and the iris by image processing. Therefore, in the present embodiment, since the center of the pupil and the center of the black eye (including both the pupil and the iris) substantially coincide with each other, the line-of-sight detection unit 111 detects the center of the black eye when detecting the black eye direction. I do.
The line-of-sight detection unit 111 first detects the positions of the corners of the eyes and the eyes from the captured image. Then, the line-of-sight detection unit 111 detects a region R12 having a low luminance from a region R11 including the corners of the eyes and the eyes as shown in FIG. 10 as a black eye region. Specifically, the line-of-sight detection unit 111 detects, for example, an area where the luminance is equal to or less than a predetermined threshold and is larger than a predetermined size as a black eye area.
Next, the line-of-sight detection unit 111 sets a black-eye detection filter including a first area and a second area as shown in FIG. 11 at an arbitrary position in the black-eye area. The line-of-sight detection unit 111 searches for the position of the black eye detection filter that maximizes the inter-region variance between the luminance of the pixels in the first region and the luminance of the pixels in the second region, and the position indicated by the search result Is detected as the center of the black eye. Finally, the line-of-sight detection unit 111 detects the three-dimensional position of the center of the black eye using the shift of the position of the center of the black eye in the stereo image, as described above.
The gaze detection unit 111 detects the black eye direction using the calculated gaze direction reference plane and the detected three-dimensional position of the center of the black eye. It is known that there is almost no individual difference in the diameter of an eyeball of an adult. Therefore, if the position of the center of the black eye when the user faces the reference direction (for example, the front) is known, conversion to the black eye direction can be calculated by obtaining the displacement from that position to the current center of the black eye. it can.
When the user faces the front, the gaze detection unit 111 uses the fact that the midpoint of the center of the left and right black eyes exists on the center of the face, that is, the gaze direction reference plane. The black eye direction is detected by calculating the distance from the reference direction of the line of sight.
Specifically, the line-of-sight detection unit 111 uses the eyeball radius R and the distance d between the midpoint of the line segment connecting the left and right black eye centers and the line-of-sight direction reference plane, as shown in Equation 1, The rotation angle θ in the left-right direction with respect to is detected as the black eye direction.
As described above, the gaze detection unit 111 detects the black eye direction using the gaze direction reference plane and the three-dimensional position of the black eye center. Then, the line-of-sight detection unit 111 detects the user's line-of-sight direction in the real space using the detected face direction and the black eye direction.
As described above, the screen attention level determination unit 103 according to the present embodiment includes the gaze detection unit 111 that detects the user's gaze direction, and the screen attention level determination unit 103 detects the gaze direction detected by the gaze detection unit 111. Based on this, the screen attention level is determined. Thereby, for example, when the user's line-of-sight direction is the direction from the user to the screen, it can be determined that the degree of screen attention is high.
Note that there are various methods for detecting the line-of-sight direction, such as a corneal reflection method, an EOG (Electrooculography) method, a search coil method, and a scleral reflection method. Therefore, the line-of-sight detection unit 111 does not necessarily need to detect the line-of-sight direction by the method described above. For example, the line-of-sight detection unit 111 may detect the line-of-sight direction using a corneal reflection method.
The corneal reflection method is a method of measuring eye movement based on the position of a corneal reflection image (Purkinje image) that appears brightly when the cornea is irradiated with point light source illumination. Since the center of the eyeball rotation and the center of the convex surface of the cornea do not coincide with each other, when the cornea is a convex mirror and the reflection point of the light source is collected by a convex lens or the like, the light collection point moves with the rotation of the eyeball. The eye movement is measured by photographing this point with an imaging device.
[Other examples of screen attention determination processing]
In the above description, the screen attention level determination unit 103 determines the screen attention level based on the line-of-sight direction of the user in the real space in the process of determining the screen attention level (S205). The method is not limited to this.
For example, the screen attention level determination unit 103 may include a facial expression determination unit that determines the facial expression of the user. In this case, the screen attention level determination unit 103 determines the screen attention level based on the user's facial expression determined by the facial expression determination unit. The user's facial expression is, for example, a smile, an expressionless face, or the like. For example, if the determined facial expression of the user is a smile, the screen attention level determination unit 103 determines that the screen attention level is high. Thereby, the push information of the related category with high possibility of being selected by the user can be displayed in an easily selectable display form. Note that the screen attention level determination unit 103 may determine that the screen attention level is high when the facial expression of the user is a predetermined facial expression. The screen attention level determination unit 103 may determine that the screen attention level is higher as the period during which the user's facial expression is a predetermined facial expression is longer.
Many methods have been proposed for facial expression recognition (judgment) methods. For example, a dynamic feature quantity based on an optical flow is extracted, and pattern recognition methods such as template matching, principal component analysis (PCA), discriminant analysis, and support vector machine (SVM) are applied. There is a way. Many methods using a time-series pattern recognition method such as a Hidden Markov Model (HMM) have also been proposed. The facial expression determination unit appropriately uses these methods to determine facial expressions.
In addition, the screen attention level determination unit 103 may include a sound collection unit that collects sound. In this case, the screen attention level determination unit 103 determines the screen attention level based on the content of the user conversation or the excitement level of the user conversation. The conversation is acquired as a voice by the voice acquisition unit.
First, the determination of the screen attention level based on the content of the conversation will be described. The content of the conversation is recognized by, for example, a known voice recognition process. For example, if the content of the recognized conversation includes laughter or the like, the screen attention level determination unit 103 determines that the screen attention level is high. Thereby, the push information of the related category with high possibility of being selected by the user can be displayed in an easily selectable display form. Note that the screen attention level determination unit 103 may determine that the screen attention level is high when the content of the conversation becomes a predetermined content. Further, it may be determined that the degree of screen attention is higher as the period during which the content of the conversation is in a predetermined state is longer.
Next, the determination of the screen attention level based on the conversation excitement level will be described. For example, when the conversation volume is higher than a predetermined value for a predetermined time or more, the screen attention level determination unit 103 determines that the conversation level is high. For example, the screen attention level determination unit 103 determines that the screen attention level is high when the conversation excitement level is high. Note that the screen attention level determination unit 103 may determine that the screen attention level is higher as the conversation volume is longer than a predetermined value.
Note that the screen attention level determination unit 103 may determine the screen attention level based on a user operation on the input device 10 for operating the display control apparatus 1000. For example, the screen attention level determination unit 103 determines that the screen attention level is high when the user's operation on the input device is a predetermined operation, and determines that the screen attention level is low otherwise. May be. For example, when the number of user operations on the input device 10 is greater than or equal to a predetermined number (for example, 5 times), it is determined that the screen attention level is high, and when the number is less than the number, the screen attention level is low. May be determined. Further, for example, it may be determined that the degree of screen attention is higher as the number of user operations increases. Further, for example, when the frequency of the user's operation on the input device 10 is equal to or higher than a predetermined frequency (for example, once per 10 minutes), it is determined that the screen attention is high, and when the frequency is less than the frequency, It may be determined that the degree of screen attention is low. Further, for example, the higher the frequency of operations, the higher the screen attention level may be determined.
12A to 11C are diagrams illustrating an example of the input device 10 in the present embodiment.
As described above, the input device 10 is, for example, a remote controller, a smartphone, a tablet terminal, or the like.
FIG. 12A is an external view illustrating an example of a remote controller. FIG. 12B is an external view illustrating an example of a smartphone. FIG. 12C is an external view illustrating an example of a tablet terminal.
Each input device 10 is provided with a “like” button physically or softly. The “Like” button is a button in which the character string “Like” is written. The “Like” button is a button that the user presses when the user feels that the content being viewed is interesting or likes.
For example, when the “Like” button is pressed by the user, the screen attention level determination unit 103 determines that the screen attention level is high.
FIG. 13A to FIG. 18C are diagrams for explaining display examples of push information in the present embodiment. 13A to 18C, it is assumed that the display unit 100 displays the content A on the entire screen 100a. 13A to 18C, a plurality of pieces of push information displayed on the screen 100a can be selected by a user operation on the input device 10.
13A, FIG. 14A, FIG. 15A, FIG. 16A, FIG. 17A, and FIG. 18A show the highest selection probability of related information among the selection probabilities of each category calculated by the selection probability calculation unit 108 in the process of step S206. It is a display example of push information in the case. The related information is push information related to the content A.
13B, FIG. 14B, FIG. 15B, FIG. 16B, FIG. 17B, and FIG. 18B show the highest selection probability of trend information among the selection probabilities of each category calculated by the selection probability calculation unit 108 in the process of step S206. It is a display example of push information in the case.
13C, FIG. 14C, FIG. 15C, FIG. 16C, FIG. 17C, and FIG. 18C show the highest selection probability of notification information among the selection probabilities of each category calculated by the selection probability calculation unit 108 in the process of step S206. It is a display example of push information in the case.
If the screen attention level is, for example, a predetermined threshold value or more, it can be estimated that the user is interested in the content A being viewed. Therefore, it can be determined that the selection probability of the related information of the content A is the highest. On the other hand, when the screen attention level is smaller than a predetermined value and the number of operations by the user with respect to the electric device 301 that transmits the notification information is less than the predetermined number, the trend information is higher than the selection probability of the notification information. The probability of selection is large (high).
In addition, when the screen attention level is smaller than a predetermined threshold and the number of operations by the user with respect to the electric device 301 that transmits the notification information is equal to or greater than the predetermined number, the notification information is more than the selection probability of the trend information. The selection probability is large (high).
13A to 13C are diagrams illustrating a state in which the size of the push information display area is changed for each category. As shown in FIGS. 13A to 13C, display areas R11, R12, and R13 are arranged on the screen 100a.
The display area R11 is an area in which push information whose category is trend information is displayed. The display area R12 is an area where push information whose category is related information is displayed. The display area R13 is an area where push information whose category is notification information is displayed.
In FIGS. 13A to 13C, “trend” is a category name of trend information. “Related” is a category name of related information. “Notification” is a category name of notification information.
Here, according to the display mode determined in step S207, the display mode determination unit 109 sets the push information display area of the category having the maximum selection probability among the plurality of categories other than the category having the maximum selection probability. It is assumed that the display unit 100 is controlled to display larger than the display area of the push information of the category.
That is, as shown in FIGS. 13A to 13C, the push information display area of the category having the maximum selection probability among the plurality of categories is made larger than the display area of push information of the category other than the category having the maximum selection probability. .
Thus, the user can easily access the push information of the category having the maximum selection probability by operating the input device 10. That is, the display control apparatus 1000 can easily select push information of a category having a high probability of being selected by the user among a plurality of categories corresponding to the plurality of push information. As described above, it is preferable to maximize the display area of the push information of the category having the maximum selection probability.
Further, as shown in FIGS. 14A to 14C, only push information belonging to the category having the highest selection probability may be displayed, and push information of other categories may be hidden. 14A to 14C, kwA indicates push information whose category is related information. kw indicates push information whose category is trend information. ntX indicates push information whose category is notification information.
In FIGS. 13A to 13C and FIGS. 14A to 14C, push information is displayed along the vertical direction at the right end of the screen 100a. However, the present invention is not limited to this. For example, push information may be displayed side by side along the horizontal direction on the lower side of the screen 100a as shown in FIGS. 15A to 15C.
In FIG. 13A to FIG. 15C, the push information is displayed superimposed on the content A. That is, the display form determination unit 109 displays a plurality of pieces of push information superimposed on the content A in the determined display form. Thereby, the user can notice the push information displayed on the screen without being prevented from viewing the content A.
16A to 16C are diagrams illustrating a state in which push information is displayed on a so-called second display (input device 10) such as a smartphone or a tablet terminal, instead of displaying the push information superimposed on the content A. is there.
In the process of step S207, the display form determination unit 109 displays the display form of the display label of the category having the maximum selection probability among the plurality of categories, and displays the category other than the category having the maximum selection probability. It may be more specific than the label display form.
Then, the display form determination unit 109 transmits the push information of the determined display form to the input apparatus 10 so that the input apparatus 10 displays the push information in the determined display form. Thereby, the input device 10 displays the push information of the determined display form.
As a result, as shown in FIGS. 16A to 16C, specific keywords (push information) are displayed only in the category having the highest selection probability, and other categories include categories such as “trend”, “related”, and “notification”. Only the name (display label) is displayed and the display is abstract. In other words, the display form determination unit 109 associates the display label of the category with the maximum selection probability with the category and each push information belonging to the category, and displays the display label of the category other than the category with the maximum selection probability. Support only categories. Thereby, the user can easily confirm push information belonging to the category having the largest selection probability.
In this way, by making the display form of the display label of the category having the maximum selection probability more specific than the display form of the display label of the category other than the category, the user operates the input device 10 so that the category is displayed. It becomes easy to access the push information. That is, the display control apparatus 1000 can easily select push information of a category having a high probability of being selected by the user among a plurality of categories corresponding to the plurality of push information. In addition, categories other than the category with the highest selection probability are displayed in an abstract manner compared to the category with the highest selection probability, so that the troublesome appearance on the screen is reduced.
Note that, according to the display mode determined in step S207, the display mode determining unit 109 displays the push information display number of the category having the maximum selection probability among the plurality of categories, other than the category having the maximum selection probability. The display unit may be controlled so as to increase the number of push information items in the category. Thereby, the user can easily select push information belonging to the category having the maximum selection probability.
In this case, as shown in FIGS. 17A to 17C, the number of push information items of the category having the maximum selection probability is maximized. That is, among the plurality of categories, the display number of push information of the category having the maximum selection probability is set to be larger than the display number of push information of a category other than the category having the maximum selection probability. That is, the display form determination unit 109 arranges the display labels of the push information of the category having the maximum selection probability side by side, and superimposes the display labels of the push information other than the category having the maximum selection probability for each category.
In this way, by maximizing the number of data items displayed in the category having the maximum selection probability, the user can easily access the push information of the category by operating the input device 10. That is, the display control apparatus 1000 can easily select push information of a category having a high probability of being selected by the user among a plurality of categories corresponding to the plurality of push information.
FIG. 18A to FIG. 18C are diagrams showing states in which the push information of the category having the maximum selection probability is focused. As described above, the push information of the category having the maximum selection probability may be focused, and the number of push information items displayed in the category may be maximized. In other words, the display form determination unit 109 determines a column composed of a plurality of push information, and uses a plurality of pushes forming a column so that the focus position is on the screen with the push information of the category having the highest selection probability as the focus position. Information may be moved in the column direction.
The screen attention level may be determined based on elements other than the user's line-of-sight direction. For example, the screen attention level determination unit 103 may determine the screen attention level based on the genre of content displayed on the display unit 100. That is, each content corresponds to a predetermined attention level corresponding to the genre of the content, and the screen attention level determination unit 103 may determine the attention level from the genre of the content displayed on the screen.
Thereby, push information that is highly likely to be selected by the user can be displayed based on the genre of the content. For example, when the content genre is drama, the user often pays attention to the screen in order to understand the story of the drama. That is, the degree of screen attention is high. Therefore, in this case, the push information related to the content is displayed in an easily selectable display form, so that there is a high possibility that the push information is selected by the user who is paying attention to the screen in order to understand the story of the drama. . On the other hand, for example, when the genre of the content is variety, the user often sees the screen while doing something other than watching the screen, so-called “watching”. That is, the degree of screen attention is low. Accordingly, in this case, push information that is not push information related to the content is displayed in a display form that can be easily selected, and thus it is highly possible that the push information is selected by the viewing user.
The screen attention level determination unit 103 may determine the screen attention level based on a viewing completion rate of the content displayed on the display unit 100. That is, each content is associated with a viewing completion rate of the content, and the screen attention level determination unit 103 has a viewing completion rate of the content displayed on the screen equal to or higher than a predetermined threshold (for example, 70%). In this case, it may be determined that the screen attention level is high, and if it is less than the threshold, it is determined that the screen attention level is low. Thereby, when the viewing completion rate is high (for example, 70% or more), the push information of the related category can be displayed in an easily selectable display form. Note that the screen attention level determination unit 103 may determine that the higher the viewing completion rate of the content displayed on the screen, the higher the screen attention level.
The push information displayed in FIGS. 13A to 13C, 14A to 14C, 15A to 15C, and 17A to 17C is displayed when, for example, it is determined that the user has the input device 10. Is done.
The display control apparatus according to this modification is substantially the same as the display control apparatus 1000 according to the above embodiment, but the configuration of the screen attention level determination unit is different. The following description will focus on differences from the display control apparatus 1000 according to the embodiment.
FIG. 19 is a block diagram showing a detailed functional configuration of the display control apparatus 2000 according to this modification.
Compared with the display control apparatus 1000 according to the embodiment shown in FIG. 3, the display control apparatus 2000 shown in the figure includes a screen attention degree determination unit 203 instead of the screen attention degree determination part 103, and the screen attention degree determination Compared with the screen attention level determination unit 103, the unit 203 further includes a friend information acquisition unit 211 that acquires content viewing information indicating a list of user's friends and content viewed by the friend, and the screen attention level determination unit 203 determines that the higher the number of friends viewing the same content as the content displayed on the display unit 100, the higher the screen attention level.
Specifically, the friend information acquisition unit 211 has a friend list in which information indicating a friend associated with the user is stored, and further displays a viewer associated with the content received by the display control apparatus 1000. The viewer list in which the indicated information is stored is acquired. The screen attention level determination unit 203 compares the friend list with the viewer list, and among the friends associated with the user, the number of friends viewing the content displayed on the display unit 100 is large. It is determined that the degree of screen attention is higher.
Thereby, as the number of friends viewing the same content as the content displayed on the display unit 100 is larger, that is, as the content is more popular among friends, the push information of the related category is easier to select. Displayed in display form. Since it is estimated that the content that is exciting among the user's friends is also highly interested in the user, there is a high possibility that the push information of the related category is selected. That is, when there are a large number of friends viewing the same content, push information that is highly likely to be selected by the user can be displayed in an easily selectable display form.
FIG. 20 is a block diagram illustrating a detailed functional configuration of the display control device 3000 according to the present modification.
Compared with the display control apparatus 1000 according to the embodiment illustrated in FIG. 3, the display control apparatus 3000 illustrated in FIG. 3 includes a screen attention level determination unit 303 instead of the screen attention level determination unit 103, and the screen attention level determination Compared with screen attention level determination unit 103, unit 303 further includes a recommender acquisition unit that acquires information indicating a recommender (curator) of the content displayed on display unit 100, and includes screen attention level determination unit 103 determines that the higher the rank of the recommender of the content displayed on the display unit is, the higher the screen attention is.
Specifically, the recommender acquisition unit 311 has a recommender order list in which information indicating the recommender associated with the user and the order of each recommender is stored, and the display control apparatus 1000 receives the recommender order list. A recommender list in which information indicating recommenders associated with content is stored is acquired.
The recommender associated with the content is, for example, a “like” button shown in FIGS. 12A to 12C among viewers viewing the same content as the content displayed on the display unit 100. Viewers. That is, when a “like” button is pressed by the viewer while viewing the content, the viewer is set as the recommender of the content.
In addition, the recommender order list stores information indicating a recommender associated with the user and the order of each recommender. The order of the recommender increases as the total number of votes by viewers within a predetermined range increases. Get higher.
The screen attention level determination unit 303 compares the recommender order list with the recommender list to determine whether the recommender of the content displayed on the display unit 100 is included in the recommender order list. However, if it is included, it is determined that the higher the rank of the recommender is, the higher the screen attention is.
As described above, the screen attention level determination unit 303 in the present modification includes a recommender acquisition unit that acquires information indicating a recommender (curator) of the content displayed on the display unit 100, and includes a screen attention level determination unit. 103 determines that the higher the rank of the recommender of the content displayed on the display unit is, the higher the screen attention is.
Thereby, the push information of the related category is displayed in a display form that is easier to select as the rank of the recommender of the content displayed on the display unit 100 is higher. Since it is estimated that the content recommended by the recommender having a high rank is useful for the user, the push information of the related category is highly likely to be selected. That is, the push information related to the content recommended by the recommender having a high rank can be displayed in an easily selectable display form.
The order of recommenders may be higher as the total number of votes by viewers within a predetermined range increases. More specifically, it is assumed that when a “like” button shown in FIGS. 12A to 12C is pressed by a viewer within a predetermined range who has watched the content recommended by the recommender, the recommender has voted.
Thereby, push information recommended by a recommender having a large total number of votes by viewers within a predetermined range can be displayed in a display form that can be easily selected. For example, in a case where viewers with similar preferences to the user are set in a predetermined range, push information that matches the user's preference can be displayed in a display form that can be easily selected.
Further, the order of recommenders may be a predetermined order corresponding to the user. That is, the order of recommenders does not have to be updated.
Moreover, in the said embodiment and each modification, the display control apparatuses 1000, 2000, and 3000 do not need to be provided with the display part 100 and the user identification part 102. FIG.
In the above-described embodiment and each modification, each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. Here, the software that realizes the display control device of each of the above embodiments is a program as follows.
That is, the program is a display control method for controlling display of a display unit having a screen on a computer, the acquisition step of acquiring a plurality of items belonging to any of a plurality of categories, and the screen of the display unit A screen attention level determination step for determining a screen attention level as a user attention level, a selection operation history collection step for collecting selection operation history information indicating a history of selection of each of the plurality of categories, and the screen attention level And a selection probability calculating step for calculating a selection probability that is a probability that the user selects for each of the plurality of categories based on the selection operation history information, and a category having a higher selection probability among the plurality of categories. And determining the display form to be displayed on the display unit in the determined display form. The plurality of categories includes a related category that is a category including items related to the content displayed on the screen, and the screen attention level is a first attention level in the selection probability calculating step. Calculating the selection probability of the related category in a case higher than the selection probability of the related category in the case where the screen attention level is a second attention level lower than the first attention level, and for each of the plurality of categories, the selection A display control method that uses operation history information to calculate a selection probability when the selected number is the first number higher than a selection probability when the selected number is the second number less than the first number. Let it run.
As described above, the display control device according to one or more aspects has been described based on the embodiments and the modifications thereof, but the present invention is not limited to these embodiments or the modifications. Unless it deviates from the gist of the present invention, various modifications conceived by those skilled in the art are applied to the present embodiment or the modified examples thereof, or a form constructed by combining the components in the different embodiments or modified examples thereof. Included within the scope of one or more embodiments.
Furthermore, the present invention can be modified as follows.
(1) Specifically, the display control device may be a computer system including a microprocessor, a ROM, a RAM, a hard disk unit, a display unit, a keyboard, a mouse, and the like. A computer program is stored in the ROM or the hard disk unit. The display control device achieves its functions by the microprocessor operating according to the computer program.
Here, the computer program is configured by combining a plurality of instruction codes indicating instructions for the computer in order to achieve a predetermined function. Each device is not limited to a computer system including all of a microprocessor, a ROM, a RAM, a hard disk unit, a display unit, a keyboard, a mouse, and the like, and may be a computer system including a part of them.
(2) A part or all of the constituent elements constituting the display control apparatus may be configured by one system LSI (Large Scale Integration). The system LSI is an ultra-multifunctional LSI manufactured by integrating a plurality of components on a single chip. Specifically, the system LSI is realized by a computer system including a microprocessor, a ROM, a RAM, and the like. it can. A computer program is stored in the ROM. The system LSI achieves its functions by the microprocessor operating according to the computer program.
(3) A part or all of the components constituting the display control device may be configured as an IC card that can be attached to and detached from the display control device or a single module. The IC card or the module is a computer system including a microprocessor, a ROM, a RAM, and the like. The IC card or the module may include the super multifunctional LSI described above. The IC card or the module achieves its function by the microprocessor operating according to the computer program. This IC card or this module may have tamper resistance.
(4) The present invention may be a method in which the operations of the characteristic components included in the display control device described above are used as steps. Moreover, the computer program which implement | achieves these methods with a computer may be sufficient, and the digital signal which consists of the said computer program may be sufficient.
The present invention also provides a computer-readable recording medium such as a flexible disk, hard disk, CD-ROM, MO, DVD, DVD-ROM, DVD-RAM, BD (Blu-ray Disc). (Registered Trademark)), or recorded in a semiconductor memory or the like. Further, the present invention may be realized by the computer program or the digital signal recorded on these recording media.
(6) The above display control device is incorporated in a smart TV, a tablet capable of reproducing a 20-inch 4k2k resolution video, a cradle, or the like. By incorporating the display control device according to the present invention, a smart TV, a tablet, and a cradle capable of displaying information that is highly likely to be selected by the user are realized.
A display control device according to one embodiment of the present invention is useful as a device that performs display control so that a user can easily access a category that has a high probability of being selected from various categories of information.
DESCRIPTION OF SYMBOLS 100 Display part 101 Push information management part 102 User identification part 103,203,303 Screen attention degree determination part 104 Selection operation history collection part 105 Equipment operation history collection part 106 Operation history storage part 108 Selection probability calculation part 109 Display form determination part 110 Participation degree determination unit 111 Line-of-sight detection unit 200 Imaging device 211 Friend information acquisition unit 311 Recommender acquisition unit 1000, 2000, 3000 Display control device
A display control device for controlling display of a display unit having a screen,
A management unit for managing a plurality of items belonging to one of a plurality of categories;
A screen attention level determination unit that determines a screen attention level that is a user's attention level with respect to the screen of the display unit;
A selection operation history collection unit that collects selection operation history information indicating a history of selection of each of the plurality of categories;
A selection probability calculation unit that calculates a selection probability that is a probability that the user selects for each of the plurality of categories based on the screen attention level and the selection operation history information;
A category having a higher selection probability among the plurality of categories, an item of the category is determined as an easily selectable display form, and a display form determining unit that displays the determined display form on the display unit,
The plurality of categories include a related category that is a category including items related to the content displayed on the screen,
The selection probability calculation unit
Calculating the related category selection probability when the screen attention level is the first attention level higher than the selection probability of the related category when the screen attention level is the second attention level lower than the first attention level;
For each of the plurality of categories, using the selection operation history information, the selection probability when the number of times of selection is the first number is the same as when the number of times of selection is the second number less than the first number of times. A display control device that calculates higher than the selection probability.
The display control device communicates with at least one electric device;
The plurality of categories include a notification category that is a category composed of items notified from the electrical device,
The display control device further includes a device operation history collection unit that collects device operation history information indicating a history of operations of the electric device by the user,
The selection probability calculation unit further includes:
Using the device operation history information, the selection probability of the notification category when the number of times the electric device has been operated is the third number, and the fourth number in which the number of times the electric device has been operated is smaller than the third number. The display control device according to claim 1, wherein the display control device calculates a higher than the selection probability of the notification category in the case of.
Each item of the notification category is associated with an announcement strength indicating the importance of notification of the item to the user,
The selection probability calculation unit calculates a notification category selection probability when the announcement strength is a first strength higher than a notification category selection probability when the announcement strength is a second strength lower than the first strength. The display control apparatus according to 2.
The display control apparatus according to claim 1, wherein the item is push information transmitted from an external device that communicates with the display control apparatus.
The display unit displays content,
The display control apparatus according to claim 1, wherein the display form determination unit displays the plurality of items in a superimposed manner on the content in the determined display form.
The display form determination unit makes the display form of the display label of the category having the maximum selection probability among the plurality of categories more specific than the display form of the display label of the category other than the category having the maximum selection probability. The display control apparatus of any one of Claims 1-5.
The display form determination unit associates the display label of the category with the maximum selection probability with the category and each item belonging to the category, and displays the display label of the category other than the category with the maximum selection probability only in the category. The display control device according to claim 6.
The display form determination unit makes a display area of an item of the category having the maximum selection probability among the plurality of categories larger than a display area of an item of a category other than the category having the maximum selection probability. The display control apparatus according to any one of 5.
The display form determination unit increases the number of display items of the category having the maximum selection probability among the plurality of categories more than the display number of items of the category other than the category having the maximum selection probability. The display control apparatus according to any one of 5.
The display according to claim 9, wherein the display form determination unit arranges and arranges display labels of items of the category having the maximum selection probability, and superimposes display labels of items other than the category having the maximum selection probability for each category. Control device.
The display form determination unit determines a column including the plurality of items, and sets the plurality of columns forming the column so that the focus position is on the screen with an item of the category having the maximum selection probability as a focus position. The display control apparatus according to claim 9, wherein the items are moved in the column direction.
The screen attention level determination unit includes a gaze detection unit that detects a gaze direction of the user,
The display control apparatus according to claim 1, wherein the screen attention level determination unit determines the screen attention level based on the line-of-sight direction detected by the line-of-sight detection unit.
The display control apparatus according to any one of claims 1 to 11, wherein the screen attention level determination unit determines the screen attention level based on a genre of content displayed on the display unit.
The display control apparatus according to claim 1, wherein the screen attention level determination unit determines the screen attention level based on a viewing completion rate of content displayed on the display unit.
The display control device is operated by an input device for operating the display control device,
The display control apparatus according to claim 1, wherein the screen attention level determination unit determines the screen attention level based on a user operation on the input device.
The display control device according to claim 15, wherein the input device is a remote control.
The display control device according to claim 15, wherein the input device is a smartphone or a tablet terminal.
The screen attention level determination unit further includes a facial expression determination unit that determines the facial expression of the user,
The display control device according to claim 1, wherein the screen attention level determination unit determines the screen attention level based on the user's facial expression determined by the facial expression determination unit.
The screen attention level determination unit further includes an audio acquisition unit for acquiring audio,
The display control according to any one of claims 1 to 11, wherein the screen attention level determination unit determines the screen attention level based on content of the user's conversation acquired as a voice by the voice acquisition unit. apparatus.
The display according to any one of claims 1 to 11, wherein the screen attention level determination unit determines the screen attention level based on a degree of excitement of the user's conversation acquired as voice by the voice acquisition unit. Control device.
The display control device further includes a user identification unit that identifies a user located in front of the screen of the display unit,
The screen attention level determination unit further includes a friend information acquisition unit that acquires content viewing information indicating a list of the user's friends and content viewed by the friends,
The screen attention level determination unit determines that the screen attention level is higher as the number of friends viewing the same content as the content displayed on the display unit is larger. The display control apparatus according to 1.
The screen attention level determination unit further includes a recommender acquisition unit that acquires information indicating a recommender of the content displayed on the display unit,
The display control device according to any one of claims 1 to 11, wherein the screen attention level determination unit determines that the screen attention level is higher as the order of recommenders of content displayed on the display unit is higher. .
The display control apparatus according to claim 22, wherein the rank of the recommender is higher as the total number of votes by viewers within a predetermined range is higher.
An integrated circuit for controlling display of a display unit having a screen,
For each of the plurality of categories, using the selection operation history information, the selection probability when the number of times of selection is the first number is the same as when the number of times of selection is the second number less than the first number of times. An integrated circuit that calculates higher than the selection probability.
A display control method for controlling display of a display unit having a screen by a display control device ,
An acquisition step in which the management unit included in the display control apparatus acquires a plurality of items belonging to any of a plurality of categories;
A screen attention degree determination unit that the screen control degree included in the display control device determines a screen attention degree that is a user attention degree with respect to the screen of the display section,
A selection operation history collection step in which the selection operation history collection unit included in the display control device collects selection operation history information indicating a history in which each of the plurality of categories is selected;
A selection probability that a selection probability calculation unit included in the display control device calculates a selection probability that is a probability that the user selects each of the plurality of categories based on the screen attention level and the selection operation history information A calculation step;
The display form determination unit included in the display control device determines the category having a higher selection probability among the plurality of categories as the easily selectable display form, and displays the determined display form on the display unit. A display form determining step
In the selection probability calculating step,
For each of the plurality of categories, using the selection operation history information, the selection probability when the number of times of selection is the first number is the same as when the number of times of selection is the second number less than the first number of times. A display control method that calculates higher than the selection probability.
A program for causing a computer to execute the display control method according to claim 25.
JP2013510156A 2011-10-19 2012-09-27 Display control apparatus, integrated circuit, display control method, and program Active JP5869558B2 (en)
JP2011229825 2011-10-19
PCT/JP2012/006187 WO2013057882A1 (en) 2011-10-19 2012-09-27 Display control device, integrated circuit, display control method and program
JP2013510156A JP5869558B2 (en) 2011-10-19 2012-09-27 Display control apparatus, integrated circuit, display control method, and program
JPWO2013057882A1 JPWO2013057882A1 (en) 2015-04-02
JP5869558B2 true JP5869558B2 (en) 2016-02-24
ID=48140552
JP2013510156A Active JP5869558B2 (en) 2011-10-19 2012-09-27 Display control apparatus, integrated circuit, display control method, and program
US (1) US9021395B2 (en)
JP (1) JP5869558B2 (en)
CN (1) CN103229174B (en)
WO (1) WO2013057882A1 (en)
KR20150142734A (en) 2014-06-11 2015-12-23 삼성디스플레이 주식회사 Display apparatus and method of driving thereof
CN106534879B (en) * 2016-11-08 2020-02-07 天脉聚源(北京)传媒科技有限公司 Live broadcast switching method and system based on attention
JPH0520016A (en) 1991-07-16 1993-01-29 Casio Comput Co Ltd Icon menu display device
JPH11272705A (en) 1998-03-24 1999-10-08 Oki Electric Ind Co Ltd Method for providing information in kiosk system
JP4366593B2 (en) 2004-07-22 2009-11-18 ソニー株式会社 Electronic device, display control method for electronic device, and program for graphical user interface
JP4892971B2 (en) 2005-12-27 2012-03-07 株式会社Ｊｖｃケンウッド Information retrieval apparatus and program
JP2010140307A (en) 2008-12-12 2010-06-24 Victor Co Of Japan Ltd Search system and content server
2012-09-27 JP JP2013510156A patent/JP5869558B2/en active Active
2012-09-27 CN CN201280003872.2A patent/CN103229174B/en active IP Right Grant
2012-09-27 US US13/989,875 patent/US9021395B2/en active Active
2012-09-27 WO PCT/JP2012/006187 patent/WO2013057882A1/en active Application Filing
US20140053105A1 (en) 2014-02-20
CN103229174A (en) 2013-07-31
CN103229174B (en) 2016-12-14
WO2013057882A1 (en) 2013-04-25
US9021395B2 (en) 2015-04-28
JPWO2013057882A1 (en) 2015-04-02
US9628844B2 (en) 2017-04-18 Determining audience state or interest using passive sensor data
CN104102927B (en) 2019-08-09 Execute the display device and method thereof of user&#39;s checking
US20150304253A1 (en) 2015-10-22 Experience Sharing with Commenting
US20160191995A1 (en) 2016-06-30 Image analysis for attendance query evaluation
JP5345129B2 (en) 2013-11-20 User interface device, user interface method, and recording medium
Ref document number: 5869558