Abstract:
An audio/video set is operated with hierarchical menus. It displays a menu string of first items in a first coordinate direction on the screen and detects a user selecting an item thereamong. Upon so detecting, the set displays a menu string of second items in a coordinate direction transverse to the first direction and through the selected item. It detects user selection among the second items for activating an associated television functionality. It displays the items in a bulletized manner as annotated by supporting indicativity.

Description:
BACKGROUND OF THE INVENTION 
     Field of the Invention 
     The invention relates to a method for operating an audio/video set as based on hierarchical menuing, the method comprising displaying a first menu string of selectable first items in a first coordinated direction on a screen and detecting user selection among the first items. The invention further relates to an audio/video set encompassing a display arranged according to practice this method. 
     Examples of such audio/video sets are television sets, HiFi sets, recorders, disc players, etc., inclusive of set-top boxes, remote control devices and similar devices associated to such sets, and hybrid sets, such as, a combination of a TV and a VCR, or with still other devices. 
     Description Of The Related Art 
     Various categories of the above, such as television sets, are notoriously difficult to operate and, in particular, to program. The number of television channels, functionality modes, parameter settings, image subdivisions, recorder functions and others, are great enough to embarrass most non-professional users. Applicants have experienced that for optimally guiding a user, a limited but explicit amount of on-screen text should be available. Similar arguments apply to various other categories of such audio/video sets. Moreover, nonuniformity among such categories is being experienced by a user as annoying. 
     By itself, IBM TDB Vol 34, No.8, p.432-433, January 1992 gives a hierarchical menu structure with bulletized strings disposed in vertical and horizontal directions, but absence therein of further displayed specifying information renders such menu little useful for controlling a specific device like an audio/video set for household use. 
     SUMMARY OF THE INVENTION 
     In consequence, among others, it is an object of the present invention to provide a better concept for a graphics-based screen layout principle for controlling and/or programming an audio/video set for household use, this concept being straightforwardly translatable among various categories of such sets. Now, therefore, according to one aspect, the invention is characterized by the steps of, under control of said detecting of a selected first item, displaying a second menu string of one or more selectable second items in a second coordinated direction on the screen transverse to said first direction and intersecting the first string at the selected first item; detecting user selection among the second items for activating an associated audio/video functionality; and displaying said items in a bulletized manner while annotating by supporting indicativity. 
     The coordinate directions are often substantially perpendicular to each other, but this is not an express limitation. In principle, there may be three or more coordinate directions within the display plane. The bulletized display may, for each item, realize the associated bullet as a relatively dark disk. Other graphical elements are useful as well, such as diamonds, asterisks, etcetera. The elements may have a uniform shape, but this is not a strict requirement, certain elements may get some highlighting, coloring or enlargement. Even a certain amount of iconizing may be useful. The bulletizing may then indicate localizing and stringing of the items in question. The strings will often be straight, but some curvature could be allowed as well. Now, a particularly instructive element has proven to be the so-called puck, which may contain up to four sectors that may each selectively be “pushed away” upon user-actuation of the item in question: coexistently with this pushing, further information is then joined to the actuated item, whereby a further selecting or actuating may be effected by the user. Further supporting indicativity may be used in the form of an icon, one or more words, or other appropriate, space-saving identifiers. 
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS 
     These and further aspects and advantages of the invention will be discussed more in detail hereinafter with reference to the disclosure of preferred embodiments, and in particular with reference to the accompanying drawings, in which: 
     FIG. 1 shows a basic TV environment of the invention; 
     FIG. 2 shows the principle of diagonal cursor movement; 
     FIG. 3 shows an example of a BAR; 
     FIG. 4 shows an example of a slider; 
     FIGS. 5A and 5B show two examples of a list; 
     FIGS. 6A and 6B show two examples of a “more” item; 
     FIG. 7 shows an example of navigation support arrows; 
     FIG. 8 shows an example of a Boolean TOGGLE; and 
     FIG. 9 shows an example of a Selection List Mechanism. 
    
    
     DESCRIPTION OF THE PREFERRED EMBODIMENTS 
     Hereinafter, a list of design concept principles is presented. The controls are as much as possible put into a functional context: they appear only when the function wherein they are used becomes active. For instance, Teletext buttons are only placed on the screen when Teletext is active. Generally, the number of keys on the remote control device may remain unchanged, but in certain cases, a few remote control buttons may migrate to onscreen buttons. Also, new functions may be created on-screen without introducing them on the remote control device. Generally, remote control will have only the most frequently used functions. 
     In general, functionality has been divided over four levels: Remote Control Elements, On-screen Buttons, Primary Menu Items, and finally Secondary Menu Items that are hidden behind a so-called ‘More’ item. In this manner, certain functions may be made easily accessible, whereas others are more or less hidden deeper in the hierarchy. It is not necessary that every set category has been provided with all four levels: this depends on the type, size, and complexity of the category or set in question. 
     Accessing of the content of a button or icon is fast and easy. The navigation is adaptable to a free moving or jumping so-called “puck” element with a pointing-and-clicking feature. On-the-spot information may be activated through a specific key. When a user selects a particular item, this item will immediately present its sub-items, without a necessity for further “clicking”. A user&#39;s past selection path remains displayed on-screen for facilitating a way back. Alternative but non-selected items of this path will disappear to reduce screen pollution. Furthermore, items previous and next remain both displayed, so that a user may easily go forward and backward in the menu structure. For navigation proper, no secondary confirmation is necessary. 
     FIG. 1 shows a basic TV environment of the invention. For other audio/video set types, functionality translation is straightforward. TV set  20  has video signal receiving means such as antenna  36 , a section  24  for containing buttons  28  for manual user actuation, and a driver section  22  symbolizing in-set electronics. This section  22  furthermore has a signal port  26  for communicating wireless signals with a remote control device  30 . Speech control input and response output could be a useful feature. Remote Control Device  30  includes cursor controls  32  and further controls  34 . An upper section  21  of the TV set  20  includes;  38  having a row of bulletized items including bullets for TV, Picture, Sound and Features, and, furthermore, a column of bulletized items including bullets for TV, Install, Setup and VCR. For other types of devices and functions, a similar set of items would be provided. Through selection, the TV bullet at the intersection of the row and column has been displayed in a highlighted manner. Moving the highlighting away from the “TV”-bullet along either the row or the column to another item may cause a different bullet string to unroll from the other item than the original one if, for such other item, also a string had indeed been provided. The earlier string will then disappear. 
     FIG. 2 shows the principle of diagonal cursor movement. The user may only navigate to items that are visible and available on screen. The behavior of the selected widget or item has always precedence over the generic diagonal navigation. Thus, cursor behavior may be specified within the particular widget. If not, then the generic navigation takes over. When the cursor is controlled in a slanted manner, it will move towards the item that is closest within the quadrant or otherwise appropriate angular area associated to that direction. 
     FIG. 3 gives an example of a particular tool, in this case a BAR, that is generally used for controlling a value for a particular function. When the function is selected, the puck-shaped cursor “pushes” one of its four segments away and transforms into a bar with a range of 0 to 100% of the adjustable value. Generally, the transformed cursor indicates the applicable type of tool, and also the manner to control it. If, in the situation shown, a user will actuate cursor control to West or East, the bar will immediately begin to change its value as long as the cursor control is kept actuated in that direction. During this movement, the navigation support arrow on the side remains highlighted. 
     FIG. 4 shows an example of another tool, in this case a slider that is used when a function needs “balancing”. Upon selection of the function, the cursor puck will in similar manner as shown with reference to FIG. 3, transform into a slider with a range between −50% and +50% of the adjustable value, with a clear visual midpoint at 0%. If, in the situation shown a user will actuate cursor control to West or East, the slider immediately begins to change its value in that direction as long as the cursor control is kept actuated. During this movement, the navigation support arrow on that side remains highlighted. A number will be added when the slider or bar in question is actually applied in the interface in question. This has been shown in FIG.  3 . Both slider and bar provide immediate feedback of any change: feedback is fast, and a direct mapping exists between the adjusted value and graphic feedback. Bars and sliders may run in any other coordinate direction. 
     FIGS. 5A,  5 B give a further tool, in this case, two examples of lists for letting a user person select among a series of options of which only one may be active at a time (FIG.  5 A). When a function is selected, its options show immediately in the list. By moving East, the cursor enters the list at the Default Selection (FIG.  5 B), which may be replaced by the most recent setting. This entering may influence the actual setting of the device in a corresponding manner. Similarly, moving the cursor North or South makes the list move South and North, respectively. When a particular option has been selected, moving West operates to confirm and to return again to the next higher level. 
     FIGS. 6A,  6 B show two examples of a superbulletized or “more” item. Here, its shape (FIG.  6 A), as a plurality of quasi superimposed bullets, suggests availability of various further items. Other shapes of the item are feasible as well. When the cursor is moved South, the “more” item unfolds and reveals the further items (FIG.  6 B). The “more” feature is used for long menu rows or columns that would extend beyond an available or otherwise predetermined screen area, or if a need has been felt to keep the screen more “clean”. A “more” item may lie at either end or at both ends of a menu string. When the cursor moves to the “more” item, all or part of the hidden items will show up, and some or all of the earlier items may in turn be squeezed or wrapped up into a new or already existing “more” item. In all cases, the displaying of a string is effected by a kind of dynamical “unrolling”, so that items that are closer to the origin will be shown earlier in time than items that lie further away. This has been found to give a user the idea of commonality among the items of the string in question. 
     FIG. 7 shows an example of navigation support arrow displayed here on the puck-shaped bullet to indicate which directions a user person may take, with respect to navigating to other bullets, and also for effecting control, such as, on a bar device or slider device. Such navigation arrow is a first-level on-screen help. In the embodiment shown, three directions are allowed, but Northward is blocked. 
     FIG. 8 shows an example of another tool, in this case of a Boolean TOGGLE, which is used for a function that has only two levels. In the embodiment, user actuation will activate the default state of the toggle; in this layout, moving the cursor East will activate the other setting, which is swapped in position with the previously selected setting. Such swapping may be repeated. 
     FIG. 9 shows an example of a still further tool, in this case, of a Selection List Mechanism. This widget is a combination of a list mechanism with other widgets. It may be a further list, a Boolean Toggle, or an on-screen Button, which by themselves do not require both East and West navigation. The difference with a standard list is that here the items need not be mutually exclusive. The difference with a sub-menu is that the selection of the item in the list already implies a setting, whereas in a normal menu, selecting an item that itself has a submenu does not set anything.