Picture search method and apparatus for digital reproduction

A picture search method and apparatus for digital reproduction are provided. The picture search method includes, generating a multiple image screen by configuring one or more pictures provided before a reproduction start time selected by a user during a high-speed search to a screen or a plurality of screens, outputting the multiple image screen, and sequentially reproducing following pictures starting from a picture selected by the user among one or more pictures included in the output multiple image screen. Therefore, it is possible to allow a user to exactly select a desired reproduction start time during the high-speed search.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims the benefit of Korean Patent Application No. 10-2004-0055093, filed on Jul. 15, 2004, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates generally to a picture search method and apparatus for digital reproduction. More particularly, embodiments of the present invention relate to a picture search method and apparatus enabling a user to find an exact reproduction start time.

2. Description of the Related Art

Digital reproducers/recorders using various storage mediums such as a HDD, a DVD, or a Blu-ray Disc are today widely used. The digital reproducer/recorder provides general recording and reproducing functions and additional services, such as high-speed forward reproduction, high-speed reverse reproduction, low-speed forward reproduction, and low-speed reverse reproduction.

FIG. 1is a block diagram schematically showing a conventional digital reproduction system. Referring toFIG. 1, the conventional digital reproduction system includes a storage unit110for storing programs, a media interface120for connecting the storage unit110with a stream decoder, a stream decoder130for receiving a stream of the stored programs from the media interface120to demultiplex the stream into a plurality of programs, an audio decoder140for decoding an audio stream received from the stream decoder130, a video decoder150for decoding a video stream received from the stream decoder130, a display unit160for displaying a video picture on a screen, and a controller170for controlling respective components of the digital reproduction system.

The digital reproduction system performs a reproducing process as follows. First, a stream of a program (program stream) selected by a user among the programs stored in the storage unit110is transmitted from the storage unit110to the stream decoder130via the media interface120. The stream decoder130converts the program stream into a video Elementary Stream (ES) and outputs the video ES to the video decoder150. The video decoder150decodes only reference pictures included in the received video ES and transfers the decoded results to the display unit160. The display unit160reproduces the reference pictures.

The digital reproduction system may perform reproduction at a reproduction speed faster than a normal reproduction speed. The display unit160displays pictures while skipping some pictures according to a predetermined reproduction speed without displaying all pictures to be shown at a normal reproduction speed. If a user manipulates buttons to select desired pictures while seeing a screen during high-speed forward (or reverse) reproduction, the user may not see the desired pictures due to delay, etc. caused by a time difference between the time when the user presses the buttons and a response time of the reproduction system. Particularly, the user has more difficulty in exactly finding a desired reproduction start time at a high reproduction speed due to the lower number of pictures between reference pictures.

SUMMARY OF THE INVENTION

An aspect of the present invention provides a picture search method and apparatus allowing a user to exactly select a desired reproduction start time during high-speed search.

According to an aspect of the present invention, there is provided a picture search method for digital reproduction, comprising: generating a multiple image screen by configuring one or more pictures provided before a reproduction start time selected by a user during a high-speed search to a screen or a plurality of screens; outputting the multiple image screen; and sequentially reproducing following pictures starting from a picture selected by the user among one or more pictures included in the multiple image screen.

The generating of the multiple image screen may comprise reducing sizes of the one or more pictures and arranging the size reduced pictures on the multiple image screen.

The generating of the multiple image screen may comprise hierarchically constructing the multiple image screen by including pictures at longer time intervals between one another in an upper layer and including adjacent pictures of each picture included in the upper layer in a lower layer.

The outputting of the multiple image screen may comprise: outputting the pictures included in the upper layer and outputting pictures included in a lower layer of a picture selected by the user among the output pictures.

The high-speed search may comprise a high-speed forward search or a high-speed reverse search.

The picture search method may further comprise: storing setting information, which is used to generate the multiple image screen, including at least one of information for the number of multiple image screens, information for the number of pictures included in a multiple image screen and information as to whether or not to hierarchically construct the multiple image screen.

According to another aspect of the present invention, there is provided a picture search apparatus for digital reproduction, comprising: a multiple image screen generator generating a multiple image screen by configuring one or more pictures provided before a reproduction start time selected by a user during a high-speed search to a screen or a plurality of screens and outputting the multiple image screen to a display unit; and a reproduction controller operating to sequentially reproduce following pictures starting from a picture selected by the user among one or more pictures included in the multiple image screen output to the display unit.

The multiple image screen generator may reduce sizes of the one or more pictures and arranges the size reduced pictures on the multiple image screen.

The multiple image screen generator may hierarchically configure the multiple image screen by including pictures with longer time intervals between each other in an upper layer and including adjacent pictures of each picture included in the upper layer in a lower layer.

The multiple image screen generator may first output the pictures included in the upper layer and outputs pictures included in a lower layer of a picture selected by the user among the output pictures.

The high-speed search may include high-speed forward search and high-speed reverse search.

The picture search apparatus may further comprise a high-speed search information setting unit for storing setting information, which is used to generate the multiple image screen, including information for the number of multiple image screens, information for the number of pictures included in a multiple image screen, and information as to whether or not to hierarchically construct the multiple image screen.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 2is a block diagram schematically showing a digital reproduction system according to an embodiment of the present invention.

Referring toFIG. 2, the digital reproduction system includes a storage unit210, a media interface220, a stream decoder230, an audio decoder240, a video decoder250, a display controller260, a display unit270, a controller300, a user interface280and a picture storage unit290.

The storage unit210, which could be a disk (or a hard disk) such as a DVD or a BD, stores programs to be reproduced according to an embodiment of the present invention.

The media interface220is a device for connecting the stream decoder230with the storage unit210to read or write streams of the programs or related information stored in the storage unit210. The media interface220may be an ATA (Advanced Technology Attachment) or an ATAPI (Advanced Technology Attachment Packet Interface).

The controller300controls respective components of the digital reproduction system, that is, the stream decoder230, the audio decoder240, the video decoder250, the media interface220, etc., in response to reproduction-related commands received through the user interface280. Particularly, the controller300operates such that a plurality of frame pictures are displayed on a screen or on a predetermined number of screens before the frame pictures are normally reproduced after a high-speed search, to allow a user to exactly select a picture corresponding to his/her desired reproduction start time during high-speed forward/backward reproduction, thereby sequentially reproducing following pictures starting from the selected picture.

The stream decoder230decodes program streams received from the storage unit210via the media interface220, and outputs the decoded results as an audio ES to the audio decoder240, and as a video ES to the video decoder250, respectively. The audio decoder240decodes the audio ES received from the steam decoder230.

The video decoder250decodes the video ES received from the stream decoder230. During normal reproduction, a picture decoded by the video decoder250is provided to the display controller260and displayed. However, during high-speed reproduction, the picture decoded by the video decoder250is provided to the display controller260, after being subjected to a process such as size reduction and then stored in the picture storage unit290.

The display controller260performs a control operation for displaying the picture received from the video decoder250on the display unit270. During a high-speed search or reproduction operation, only a picture is displayed on a screen, while, when a screen for selecting a reproduction start time after high-speed search is provided, a plurality of pictures can be displayed on a screen.

The display unit270displays a screen provided by the display controller260.

The user interface280receives a reproduction-related command from a user and transfers the received command to the controller300. The user interface280may be a remote controller, a front panel, or a key pad.

The picture storage unit290is a memory for storing screen pictures processed by the display controller260.

FIG. 3is a block diagram of the controller300shown inFIG. 2. InFIG. 3, only components for processing reproduction-related operations when a picture search method according to an embodiment of the present invention is performed are shown.

Referring toFIG. 3, the controller300includes an user command interpreter310, a high-speed search information setting unit320, a high-speed search processor330, a reproduction selection processor340, a reproduction processor350and a high-speed search information register360.

The user command interpreter310receives a reproduction-related command from a user through the user interface280and interprets the reproduction-related command. Then, the user command interpreter310sends control signals and related data to corresponding components to execute the reproduction-related command. That is, if the user command interpreter310receives a user command for storing setting information related to the configuration of a screen to be shown to a user to select a reproduction start time after a high-speed search, through the user interface280, the user command interpreter310interprets the user command and transfers the interpreted result to the high-speed search information setting unit320. If the user command interpreter310receives a high-speed search command through the user interface280, the user command interpreter310interprets the high-speed search command and transfers the interpreted result to the high-speed search processor330. If the user command interpreter310receives a reproduction selection command through the user interface280, the user command interpreter310interprets the reproduction selection command and transfers the interpreted result to the reproduction selection processor340. Also, if the user command interpreter310receives a reproduction command through the user interface280, the user command interpreter310interprets the reproduction command and transfers the interpreted result to the reproduction processor350.

The high-speed search information setting unit320stores setting information related to the configuration of a screen to be shown to the user to select a reproduction start time after the high-speed search. If a user selects a setting information menu for selecting a reproduction start time after the high-speed search through the user interface280, the high-speed search information setting unit320controls the display unit270to display a menu screen as shown inFIG. 5. If the user inputs setting values to an input window of the menu screen, the user interface280receives and transmits the setting values to the user command interpreter310. Then, the user command interpreter310transfers the setting values to the high-speed search information setting unit320. The high-speed search information setting unit320stores the received setting values in the high-speed search information register360.

The setting values stored in the high-speed search information register360include the number of multiple image screens when reproduction is selected, the number of pictures included in a multiple image screen when reproduction is selected, information as to whether or not to provide a hierarchical multiple image screen when reproduction is selected, information as to whether or not to display a time when reproduction is selected, etc., as shown inFIG. 5.

The number of multiple image screens when reproduction is selected represents the number of screens to be shown to a user to select a reproduction start time after high-speed search. If the number of multiple image screens is set to 1, all pictures in a predetermined time to be shown to a user to select a reproduction start time after high-speed search is displayed on a screen. If the number of multiple image screens is set to 3, pictures in a predetermined time to be shown to the user to select a reproduction start time after high-speed search are divided and displayed on three screens.

The number of pictures included in a multiple image screen when reproduction is selected represents the number of pictures to be displayed on a screen to be shown to a user to select a reproduction start time after high-speed search.

The information as to whether or not to provide a hierarchical multiple image screen when reproduction is selected, means information as to whether or not to hierarchically construct a screen to be shown to a user to select a reproduction start time after high-speed search. Hierarchically constructing screens means to first display pictures at longer time intervals between each other on a first screen shown to a user to select a reproduction start time after high-speed search and when the user selects one of the pictures displayed on the first screen, display adjacent pictures of the selected picture on the following screen. Since users have a high probability of failing to select a desired reproduction start time at a high reproduction speed at which screens pass fast, hierarchical constructing screens is effective at the high reproduction speed.

The information as to whether or not to display a time when reproduction is selected, means information as to whether or not to display a time on a screen to be shown to the user to select a reproduction start time after high-speed search.

If the high-speed search processor330receives a high-speed search command from a user, the high-speed search processor330performs a high-speed search operation. The high-speed search command received through the user interface280includes an identifier of a reproduction program, a speed value, etc.

If the high-speed search processor330receives such a high-speed search command, the high-speed search processor330initializes and drives the storage unit210, the media interface220, the stream decoder230, the video decoder240, the display controller260, the display unit270and the screen storage unit290for high-speed reproduction. Programs stored in the storage unit210are input to the stream decoder230via the media interface220under the control of the high-speed search processor330. The stream decoder230decodes the input streams and transmits the decoded result as a video ES to the video decoder250. The video decoder250decodes the video ES and transmits the decoded results (pictures) to the display controller260. The display controller260extracts representative pictures of the pictures received from the video decoder250at a speed selected by the user and outputs the extracted representative pictures to the display unit270. Also, the display controller260reduces the sizes of the representative pictures in a predetermined proportion and transmits the size reduced pictures to the picture storage unit290to store the representative pictures therein. Reducing the sizes of the pictures in the predetermined proportion can be carried out by a separate component. Here, the predetermined proportion is decided on the basis of values stored in the high-speed search information register360.

If the reproduction selection processor (multiple screen image guide)340receives a reproduction selection command from a user, the reproduction selection processor340performs operations related to a reproduction selection process.

If the reproduction selection processor340receives a command like “reproduction selection after high-speed search” through the user interface280and the user command interpreter310, the reproduction selection processor340initializes the storage unit210, the media interface220, the stream decoder230, the video decoder250, the display controller260, etc., and then drives the display unit270, the display controller260and the picture storage unit290.

Under the control of the reproduction selection processor340, the display controller260obtains a predetermined number of pictures selected by a user from the pictures stored in the picture storage unit290and displays the pictures on a predetermined number of screens selected by the user. At this time, the size of a picture can be adjusted according to the number of pictures to be shown on a screen.

If the reproduction processor350receives a command for selecting one of pictures displayed on multiple image screens from a user, the reproduction processor350performs operations related to reproduction. That is, if the user selects one of a plurality of pictures displayed on the display unit270as a picture corresponding to a reproduction start time (if the user inputs a reproduction command), the reproduction command is transferred to the reproduction processor350through the user interface280and the user command interpreter310.

The reproduction processor350initializes and drives the storage unit210, the media interface220, the stream decoder230, the video decoder250and the display controller260. Under the control of the reproduction processor350, the display controller260sequentially provides following pictures starting from the picture corresponding to the reproduction start time to the display unit270, so that the pictures are sequentially displayed on the screen of the display unit270according to a frame ratio. If a stream is transmitted to the stream decoder230through the media interface220after a predetermined time elapses, the stream decoder230decodes the stream and transmits the decoded stream as a video ES to the video decoder250. The video decoder250decodes the video ES and transmits the decoded video ES as a decoded picture to the display controller260so that the decoded picture is displayed on the display unit270.

FIG. 4is a block diagram of the display controller260shown inFIG. 2.

Referring toFIG. 4, the display controller260includes a picture processor261, a high-speed/normal reproduction controller262, and a multiple image screen generator263.

The picture processor261receives the decoded picture from the video decoder250, reduces the size of the decoded picture in a predetermined proportion and provides the size reduced picture to the picture storage unit290to store the decoded picture therein. In a normal reproduction, the picture processor261receives the decoded picture from the video decoder250, adjusts the size of the decoded picture according to a frame ratio of the display unit270, and then provides the resultant picture to the display unit270.

The high-speed/normal reproduction controller262reproduces the picture data provided from the picture processor261at a high speed or displays the picture data normally, according to a user command.

The multiple image screen generator263constructs a multiple image screen to show a plurality of pictures on a screen when the user inputs a reproduction selection command during high-speed search. Also, one or more multiple image screens can be provided.

The multiple image screen generator263receives pictures with small sizes stored in the picture storage unit290, constructs a multiple image screen and provides the multiple image screen to the display unit270. The size of each picture included in the multiple image screen can be adjusted according to the number of pictures to be shown on a screen. If a large number of pictures should be shown on a screen, it is possible to hierarchically construct the pictures to a tree structure by allocating an upper-layer index or a lower-layer index to each picture. In detail, pictures with upper-layer indexes are first displayed (the pictures with the upper-layer indexes are representative pictures of pictures with lower-layer indexes), and if the user selects one of the displayed pictures, pictures with lower-layer indexes corresponding to the selected picture are displayed on the display unit270. As such, by displaying pictures provided between a representative picture and a previous representative picture on a multiple image screen, the user can more exactly select a desired picture.

FIG. 6is a schematic representation of a picture search method according to an embodiment of the present invention. In more detail,FIG. 6shows an exemplary screen output when the picture search method is performed.

If a high-speed search is performed when the pictures are output in the above order, predetermined representative pictures among the pictures are displayed on the display unit270according to a predetermined reproduction speed. Referring toFIG. 6, output pictures are pictures I, P, and I.

In this state, if a user selects a picture corresponding to a reproduction start time through interfacing such as pressing a button at a time T, the display unit270displays pictures included in the time interval between the reproduction start time (T) and a predetermined previous time. Referring toFIG. 6, 6 pictures of P, P, B, B, B, and I are displayed on a screen of the display unit270. A predetermined number of continuous pictures provided before the reproduction start time T can be displayed, as shown inFIG. 6, however, a predetermined number of discontinuous pictures can also be displayed.

A predetermined number of pictures among the pictures included in the time interval between the reproduction start time (T) and the predetermined previous time can be displayed on a screen of the display unit270. For example, a picture is selected and displayed on the screen for each three pictures of the predetermined number of pictures provided before the reproduction start time T. As such, intermittently displaying pictures is effective when a user has a high probability of failing to exactly select a desired reproduction start time due to a high reproduction speed at which screens are displayed fast.

FIG. 7is a schematic representation of exemplary hierarchical multiple image screens according to an embodiment of the present invention.

The hierarchical multiple image screens are created by hierarchically constructing screens to be shown to a user when the user inputs a reproduction command. For example, pictures at longer time intervals between each other are displayed on a first screen and if a user selects one of the pictures on the first screen, adjacent pictures of the selected picture are displayed on the following screen. Such a hierarchical construction allows the user to more exactly select a picture corresponding to a desired reproduction start time even during high-speed search.

Referring toFIG. 7, 4 pictures of 1st, 2nd, 3rd, and 4th pictures included in the time interval between a reproduction start time T and a predetermined previous time are constructed to a first layer, and the previous 6 pictures of the 1st picture, the previous 6 pictures of the 2nd picture, the previous 6 pictures of the 3rd picture, and the previous 6 pictures of the 4th picture are constructed to second layers.

The 1st, 2nd, 3rd, and 4th pictures are displayed on a first screen and if the user selects one of the four pictures, lower-layer pictures of the selected picture are displayed on the following screen.FIG. 8shows a case where the user selects the 1st picture.

FIG. 8is a schematic representation in which the hierarchical multiple image screens ofFIG. 7are displayed on the display unit270.

Referring toFIG. 8, the 1st, 2nd, 3rd and 4th pictures are displayed on the first screen of the multiple image screens and if the user selects the 1st picture among the four pictures, the 1st picture, a (1-1)-th picture, a (1-2)-th picture, a (1-3)-th picture, a (1-4)-th picture, a (1-5)-th picture, a (1-6)-th picture and the 2nd picture are displayed on the following second screen. The (1-1)-th, (1-2)-th, (1-3)-th, (1-4)-th, (1-5)-th and (1-6)-th pictures are the lower-layer pictures of the 1st picture, and the 2nd picture can be displayed for a next selection. To select a different picture, a list of pictures included in the first layer can be located in a portion of the multiple image screen.

FIGS. 9aand9bare a flowchart illustrating a picture search method according to an embodiment of the present invention.

Referring toFIG. 9a, if the high-speed search processor330receives a high-speed search command through the user interface280(operation901), the high-speed search processor330initializes and drives devices related to high-speed search operations (operation902). Under the control of the high-speed search processor330, the stream decoder230receives and decodes a stream (operation903) and outputs the decoded result as an ES stream to the video decoder250. The video decoder250receives the ES stream from the stream decoder230and decodes the ES stream, then transfers the decoded result (picture) to the display controller260(operation904), and the display controller260reduces the size of the decoded picture (operation905) in a predetermined proportion. Then, the size reduced picture is stored in the picture storage unit290(operation906).

Then, the display unit270receives representative pictures by the number of pictures corresponding to a predetermined reproduction speed from the display controller260and displays the received representative pictures (operation907). That is, the display controller260provides a decoded picture received from the video decoder250to the display unit270for each frame so that the decoded picture is displayed on the display unit270at a predetermined reproduction speed. Also, the display controller260reduces the size of the picture in a predetermined proportion and stores the size reduced picture in the picture storage unit290. To allow a multiple image screen (multiple screens) to be displayed on the display unit270whenever the user inputs a reproduction selection command, the picture storage unit290should store all pictures with small sizes in a multiple image screen or a plurality of multiple image screens per each unit time. To store the pictures with the small sizes in the screen storage unit290, a FIFO (First In First Out) order may be used.

During a high-speed search, if the reproduction selection processor340receives a reproduction selection command through the user interface280(operation908), the reproduction selection processor340initializes and drives a device to allow a user to select a reproduction after the high-speed search (operation909). Then, the display controller260constructs a multiple image screen using the pictures with the small sizes stored in the picture storage unit290and controls the display unit270to display the multiple image screen (operation910).

If a user selects a picture corresponding to a desired reproduction start time while seeing the multiple image screen displayed on the display unit270(if the user inputs a selection command), the reproduction processor350receives the selection command through the user interface280(operation911) and initializes and drives a device for performing reproduction operations (operation912). Then, the reproduction processor350controls such that the selected picture is displayed on the display unit270according to a frame ratio (operation913).

As described above, the high-speed search control method of an embodiment of the present invention can also be embodied as a computer readable code on a computer readable recording medium. The computer readable recording medium may be any data storage device that can store data which can be thereafter read by a computer system. Examples of a computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and carrier waves. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. Also, functional programs, codes, and code segments for implementing the high-speed search control method are well known to programmers in the art.

As described above, according to an embodiment of the present invention, it is possible to allow a user to exactly select a desired reproduction start time during a high-speed search.