Source: https://patents.google.com/patent/JP2005020778A/en
Timestamp: 2020-01-29 14:17:27
Document Index: 538077188

Matched Legal Cases: ['art 607', 'art 604', 'art 601', 'art 604', 'art; 604', 'art; 6041', 'art; 6043', 'art; 605', 'art; 606', 'art; 608']

JP2005020778A - Digital video information apparatus and method with consecutive still image capturing function - Google Patents
Digital video information apparatus and method with consecutive still image capturing function Download PDF
JP2005020778A
JP2005020778A JP2004246501A JP2004246501A JP2005020778A JP 2005020778 A JP2005020778 A JP 2005020778A JP 2004246501 A JP2004246501 A JP 2004246501A JP 2004246501 A JP2004246501 A JP 2004246501A JP 2005020778 A JP2005020778 A JP 2005020778A
JP2004246501A
2004-08-26 Application filed by Toshiba Corp, 株式会社東芝 filed Critical Toshiba Corp
2004-08-26 Priority to JP2004246501A priority Critical patent/JP2005020778A/en
2005-01-20 Publication of JP2005020778A publication Critical patent/JP2005020778A/en
<P>PROBLEM TO BE SOLVED: To consecutively capture a plurality of still images from a video signal even without requiring a user to select and set still images to be captured one by one. <P>SOLUTION: The digital video information apparatus comprises a key input part 607 which designates a consecutive still image capturing mode, a frame change detection part 604 for detecting that video contents of a captured frame are different from the contents of a preceding frame, from an inputted video signal after transition to the consecutive still image capturing mode, an encoder part 601 which compresses captured frame data into I pictures of MPEG on the basis of information from the detection part to produce a pack structure designated by RTR-DVD standards, and a reproduction management information creation part 604 which creates reproduction management information (S_VOG_GI) from information relating to the I pictures produced in the encoder part. <P>COPYRIGHT: (C)2005,JPO&NCIPI
The present invention relates to a digital video information apparatus and method having a still image continuous capturing function.
Currently, MPEG2 (Moving Picture Expert Group 2) system is used for digital recording / playback of video (moving picture), and AC-3 (Digital Audio Compression 3) system is used for digital recording / playback of audio (voice). The DVD video standard is compiled, and various playback devices (DVD video players) using this standard are commercially available.
According to the MPEG2 system layer, this DVD video standard supports MPEG-2 as a moving picture compression system and AC-3 audio and MPEG audio as a voice recording system in addition to linear PCM. The DVD video standard also supports sub-picture data for subtitles, navigation data for playback control such as fast-forward / rewind data search, and ISO 9660 and UDF bridge formats for computers.
Furthermore, writable DVD discs (read-write DVD-RAM, rewritable DVD-RW, or write-once DVD-R) have been developed, and digital video information using writable DVD discs An environment that enables development of recording / playback devices (digital video disk recorders replacing conventional analog video cassette recorders) has been created.
From the above situation, a real-time recording standard for DVDs (RTR-DVD standard) has been proposed to perform digital recording / playback of video images and the like in real time, and is being put together as an official standard. This RTR-DVD standard is considered based on the DVD video standard that has already been accepted by the market as an official standard, and a file system corresponding to this RTR-DVD standard is currently being standardized.
By the way, in the RTR-DVD standard, a maximum of 63936 still images (still pictures) (= maximum number of still cells 999 × maximum number 64 in a video object group) can be recorded. As a source of this still image, an electronic still camera (digital camera) or the like can be considered. In this electronic still camera, a semiconductor memory such as an IC card is used as a recording medium for a photographed still image.
On the other hand, a disc medium such as an optical disc is used for the RTR-DVD video recorder. That is, the recording medium used differs between the electronic still camera and the RTR-DVD video recorder. For this reason, it is not easy to directly capture still image data created by an electronic still camera into an RTR-DVD video recorder.
In addition, when capturing a plurality of still images from a video signal (a normal video signal or a video signal including a plurality of still images created by an electronic still camera or a digital video movie) Each captured still image must be selected and set, which is very troublesome.
The present invention has been made in view of the above circumstances, and it is possible to continuously capture a plurality of still images from a video signal without the user having to select and set each captured still image one by one. It is an object of the present invention to provide a digital video information apparatus with an embedded function.
Another object of the present invention is to provide a multiple still image recording method for continuously capturing and recording a plurality of still images from a video signal without the user having to select and set each captured still image one by one. That is.
A digital video information apparatus according to an embodiment of the present invention includes a key input unit (607) for designating a still image continuous capturing mode; and after the transition to the still image continuous capturing mode, capturing is performed from an input video signal. A frame change detection unit (604) for detecting that the video content is different from the previous frame; based on the information from the detection unit, the captured frame data is compressed into an MPEG I picture, and the RTR-DVD standard An encoder unit (601) that generates the pack structure specified in the above; and a reproduction management information creation unit (604) that creates reproduction management information (S_VOG_GI) from information related to the I picture generated by the encoder unit. ing.
In the multiple still image recording method according to another embodiment of the present invention, a still image group (VOG) of a plurality of still images within a predetermined number (64) is set (ST114 in FIG. 14; ST214 in FIG. 18). ); After recording of the video information is started (YES in ST116 in FIG. 14; YES in ST216 in FIG. 18), recording of the plurality of still images included in the video information is performed on the data recording area of the information medium (100). Performed continuously (recording processing loop including ST118 in FIG. 14; recording processing loop including ST218 in FIG. 18); management information (VOG information) for collecting the recorded still images for each still image group (VOG) S_VOG_GI) of FIG. 13 is created (ST120 of FIG. 14; ST220 of FIG. 19); the information medium (100) on which the plurality of still images are recorded The management information recording area (VMG / S_AVFIT), writes the management information created in the above (S_VOG_GI); and the (ST140 in FIG. 14 ST140 in FIG. 20) as.
By doing so, it is possible to construct a system in which a plurality of still images are automatically and continuously captured from a video signal including a plurality of still images that are continuously reproduced like a slide show and recorded in the RTR-DVD format.
A digital video information apparatus with a still image continuous capturing function according to an embodiment of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram illustrating the overall configuration of a digital video information apparatus (RTR-DVD video recorder) with a still image continuous capturing function according to an embodiment of the present invention.
The apparatus main body of the RTR-DVD video recorder shown in FIG. 1 is roughly driven by rotating a recordable / reproducible optical disc 100 such as a DVD-RAM, DVD-RW, or DVD-R, and information on the disc 100 is recorded. It comprises a disk drive unit 609 that performs reading and writing, an encoder unit 601 that constitutes the recording side, a decoder unit 602 that constitutes the playback side, and a main MPU unit 604 that controls the operation of the entire apparatus.
Furthermore, the data bus connecting the disk drive unit 609 and the main MPU unit 604 has a large capacity (for example, 30 GB to 100 GB or more) and a high speed (data transfer rate equal to or higher than that of the IEEE 1394 serial bus; specifically, 400 Mpbs) (˜500 Mbps class) A recorder unit 700 using a hard disk drive (HDD) can be connected.
The large-capacity high-speed HDD recorder unit 700 is not always necessary depending on the embodiment of the present invention. However, when the disk drive unit 609 such as a DVD-RAM and the HDD recorder unit 700 are integrated, for example, It becomes possible.
That is, an air check of a TV broadcast program or the like is performed by the HDD recorder unit 700. Among the air-checked programs, if there are some programs that the user does not want to erase (program contents that are not copy-restricted), they are appropriately connected, edited, set to a DVD-RAM disc, a DVD-RW disc, Alternatively, it is copied (backed up) to a DVD-R disk. Then, it becomes possible to permanently store the desired program air-checked by the HDD recorder unit 700, and on the other hand, the portion copied to the disk can be deleted from the HDD recorder unit 700 (such as discarding the copied program file to the trash can icon). ). Then, an extra recording space can be secured in the HDD recorder unit 700 as much as the file size discarded in the trash can icon.
Alternatively, for example, an air check of a long-time TV program that does not fit on a 4.7 GB capacity DVD-RAM disk is performed by the HDD recorder unit 700 having a large capacity (free space of, for example, 30 GB), and the air-checked long time program is later performed. It is also possible to copy from the HDD recorder unit 700 to a plurality of DVD-RAM disks. In this way, it is possible to prevent air check leakage occurring during a period (several seconds to several tens of seconds) required for disk replacement (or switching of recording disks).
Alternatively, a DVD-VR video signal, a DVD-AR audio signal, and a DVD-SR stream signal are arbitrarily recorded in the HDD recorder unit 700 in advance. Later, only the DVD-VR video signal is copied from the HDD recorder unit 700 to a certain DVD-RAM disk, only the DVD-AR audio signal is copied to another DVD-RAM disk, and only the DVD-SR stream signal is further copied. It can also be copied to another DVD-RAM disk.
The HDD recorder unit 700 is not built in the apparatus of FIG. 1, but this apparatus is configured exclusively for an optical disk recorder, and an IEEE 1394 interface for connecting the HDD recorder unit 700 to this apparatus (or a space for mounting the HDD recorder unit later). And its connection slot).
The encoder unit 601 in FIG. 1 includes an A / D conversion unit 614, a video encoding unit 616, an audio encoding unit 617, a sub-picture (SP) encoding unit 618, a formatter unit 619, and a buffer memory unit 620. ing.
The A / D converter 614 receives an external analog video signal + external analog audio signal from the AV input unit 612 or an analog TV signal + analog audio signal from the TV tuner unit 613. The A / D converter 614 digitizes the input analog video signal with, for example, a sampling frequency of 13.5 MHz and a quantization bit number of 8 bits. Similarly, the A / D conversion unit 614 digitizes the input analog audio signal with, for example, a sampling frequency of 48 kHz and a quantization bit number of 16 bits.
When an analog video signal and a digital audio signal are input to the A / D conversion unit 614, the A / D conversion unit 614 passes the digital audio signal through. On the other hand, when a digital video signal and a digital audio signal are input to the A / D conversion unit 614, the A / D conversion unit 614 causes the digital video signal and the digital audio signal to pass through.
The digital video signal component from the A / D conversion unit 614 is sent to the formatter unit 619 via the video encoding unit 616. The digital audio signal component from the A / D conversion unit 614 is sent to the formatter unit 619 via the audio encoding unit 617.
The video encoder 616 has a function of converting an input digital video signal into a digital signal compressed at a variable bit rate based on the MPEG2 (or MPEG1) standard. The audio encoding unit 617 has a function of converting the input digital audio signal into a digital signal (or linear PCM digital signal) compressed at a fixed bit rate based on the MPEG or AC-3 standard.
When a DVD video signal is input from the AV input unit 612, or when a DVD video signal is broadcast and received by the TV tuner unit 613, a character broadcast signal component (or closed caption CC) in the DVD video signal is received. , Input to the SP encoding unit 618. The sub-picture data input to the SP encoding unit 618 is arranged in a predetermined signal format and sent to the formatter unit 619.
The formatter unit 619 performs predetermined signal processing on the input video signal, audio signal, sub-video signal, etc. while using the buffer memory unit 620 as a work area, and matches the predetermined format (file structure). The recording data is output to a data processor unit (D-PRO unit) 610.
Here, a standard encoding process for creating the recording data will be briefly described. That is, when the encoding process is started in the encoder unit 601 in FIG. 1, parameters necessary for encoding video data and other parameters are set. Next, the main video data is pre-encoded using the set parameters, and the optimal code amount distribution for the set average transfer rate (recording rate) is calculated. Based on the code amount distribution obtained by the pre-encoding in this way, the main video is encoded. At this time, audio data is also encoded at the same time.
As a result of pre-encoding, when the data compression amount is insufficient (when the desired video program does not fit in the DVD-RAM disc, DVD-RW disc, DVD-R disc, or HDD recorder unit 700 to be recorded), If you have the opportunity to pre-encode again (for example, if the source of the recording is a reproducible source such as a videotape or video disc), a partial re-encoding of the main video data will be performed and the main part of the re-encoded part will be The video data is replaced with the main video data portion pre-encoded before that. By such a series of processing, main video data and audio data are encoded, and the average bit rate value required for recording is greatly reduced.
Similarly, parameters necessary for encoding the sub-picture data are set, and the encoded sub-picture data is created.
The main video data, audio data, and sub-video data encoded as described above are combined and converted into an RTR-DVD video structure.
The encoded main video data, audio data and sub-video data are subdivided into packs of a certain size (2048 bytes) as shown in the lower part of FIG. A dummy pack (not shown) is appropriately inserted into these packs. Note that time stamps such as PTS (presentation time stamp) and DTS (decode time stamp) are appropriately described in packs other than dummy packs. For the sub-picture PTS, a time arbitrarily delayed from the PTS of the main picture data or audio data in the same reproduction time zone can be described.
And each data cell is arrange | positioned per video object unit (VOBU) so that it can reproduce | regenerate in the time code order of each data, and VOB comprised by a some cell is comprised. One or more VR_MOVIE. VRO file, VR_STILL. VRO file, VR_AUDIO. A VRO file or the like is formatted with the directory structure of FIG.
If the DVD video playback signal can be digitally copied, the contents of the cell, program chain, management table, time stamp, and the like are determined from the beginning, and need not be created again. However, in order to configure the RTR-DVD video recorder so that the DVD playback signal can be digitally copied, it is necessary to take appropriate copyright protection means.
A disk drive unit 609 that reads and writes (records and / or plays) information on a DVD disk (DVD-RAM, DVD-RW, DVD-R, DVD-ROM) 100 includes a D-PRO unit 610, a temporary A storage unit 611, a system time counter (or system time clock) STC unit 650, and the like are connected.
The D-PRO unit 610 supplies the RTR-DVD recording data from the encoder unit 601 to the disk drive unit 609 and / or the HDD recorder unit 700, or the disk 100 or the HDD recorder unit 700 under the control of the main MPU unit 604. The RTR-DVD playback signal is extracted from the disc, the management information (part of the file data in FIG. 2) recorded on the disc 100 is rewritten, or the data (part or all of the file) recorded on the disc 100 is deleted ( To discard the file in the trash can icon).
The temporary storage unit 611 buffers a certain amount of data written to the disk 100 via the disk drive unit 609 (data output from the encoder unit 601), or the disk 100 via the disk drive unit 609. This is used to buffer a certain amount of data reproduced from (data input to the decoder unit 602).
For example, when the temporary storage unit 611 is configured by a 4 Mbyte semiconductor memory (DRAM), it is possible to buffer recording or reproduction data for about 8 seconds at an average recording rate of 4 Mbps. Further, when the temporary storage unit 611 is composed of a 16 Mbyte EEPROM (flash memory), it is possible to buffer recording or reproduction data of about 30 seconds at an average recording rate of 4 Mbps. Further, for example, a part of the recording area of the HDD recorder unit 700 can be used for buffering of reproduction data.
The temporary storage unit 611 (or HDD recorder unit 700) can be used to temporarily store recording information until the disk 100 is replaced with a new disk when the disk 100 is used up during recording.
The temporary storage unit 611 is also used to temporarily store data read out from the normal drive within a certain time when a high-speed drive (double speed or higher) is adopted as the disk drive unit 609. it can. If the read data at the time of reproduction is buffered in the temporary storage unit 611, the reproduction data buffered in the temporary storage unit 611 is switched and used even when an optical pickup (not shown) causes a read error due to vibration shock or the like. As a result, it is possible to prevent the playback video from being interrupted.
Although not shown in FIG. 1, if an external card slot is provided in the RTR-DVD video recorder, the EEPROM can be sold separately as an optional IC card. If the RTR-DVD video recorder is provided with an external drive slot or USB interface, the HDD can also be sold separately as an optional expansion drive.
When a personal computer with a DVD-RAM drive is converted into an RTR-DVD video recorder by software (not shown), a part of the free area of the hard disk drive of the personal computer itself or a part of the main memory is shown in FIG. 1 temporary storage unit 611 can be used.
The main MPU unit 604 in FIG. 1 includes a program ROM unit 604c in which a control program (the processing in FIGS. 14 to 23) and the like are written in addition to a microcomputer (MPU or CPU) which is the heart of the main MPU unit, kanji and other characters. The ROM unit 604b includes a work RAM unit 604a that provides a work area necessary for program execution (execution of the processes of FIGS. 14 to 23).
The main MPU unit 604 further includes a directory detection unit 6041 that detects a directory (hierarchical file structure as shown in FIG. 2) of a data file recorded on the disc 100 (or HDD recorder unit 700) of FIG. A video object grouping unit (VOG unit) 6043. The directory detection unit 6041 and the VOG conversion unit 6043 are physically written in the program ROM unit 604c as firmware executed by the main MPU unit 604.
The MPU of the main MPU unit 604 executes the processes shown in FIGS. 14 to 23, which will be described later, using the RAM as a work area in accordance with a control program stored in the ROM.
In these processes, data input by the user of the RTR-DVD video recorder (various process commands, still image recording time to be continuously captured, still image continuous capture start command, text input regarding recording contents, etc.) are keys. Provided from the input unit 607 to the main MPU unit 604. As the key input unit 607, although not shown, a keyboard of a personal computer or a cursor key / ten key of a remote controller can be used.
Among the execution results of the main MPU unit 604, the contents to be notified to the user of the RTR-DVD video recorder are displayed on the display unit 608 of the RTR-DVD video recorder. The notification content is appropriately displayed on the monitor display using an on-screen display (OSD), a sub-picture, or the like.
Note that the timing at which the main MPU unit 604 controls the disk drive unit 609, the D-PRO unit 610, the encoder unit 601, and / or the decoder unit 602 can be determined based on time data from the STC unit 650 (recording). The reproduction operation is normally executed in synchronization with the time clock from the STC unit 650, but other processing may be executed at a timing independent of the STC unit 650).
The main MPU unit 604 can also execute processing such as recording date and time of each program recorded on the disk 100 and entry point registration date and time based on time data from a timer clock generator (not shown). It has become.
A decoder unit 602 in FIG. 1 includes a separation unit 625 that separates and extracts each pack from RTR-DVD playback data having a pack structure as shown in FIG. 3, a memory 626 that is used when performing pack separation and other signal processing, A video decoding unit 628 that decodes the main video data (contents of the video pack) separated by the separation unit 625, and a sub video (SP) that decodes the sub-video data (contents of the sub-video pack) separated by the separation unit 625. The decoding unit 627, the audio decoding unit 630 that decodes the audio data (the contents of the audio pack) separated by the separating unit 625, and the sub-picture data from the SP decoding unit 627 are appropriately combined with the video data from the video decoding unit 628. The video, menu, highlight button, subtitles and other sub-videos are superimposed on the main video and output. And Opurosesa (V-PRO) unit 638, and a D / A converter section (audio) 632 that converts the digital audio output from the audio decoding unit 630 into an analog audio signal.
Here, the video decoding unit 628 includes a reduced image (thumbnail picture) generation unit 628a. The generation unit 628 a is configured to reduce the read image data and transfer it to the frame memory unit 606, and output a reduced image (thumbnail picture) to the external monitor TV 637.
Main video data (including appropriately reduced image data) output from the V-PRO unit 638 and OSD data (such as text) appropriately supplied from the main MPU unit 604 are input to the video mixing unit 605. This OSD data is superimposed on the main video data from the V-PRO unit 638 on the frame memory unit 606. The main video data on which the OSD data is superimposed is output from the video mixing unit 605.
The digital video output from the video mixing unit 605 is output to the outside via the digital output I / F 634, converted into an analog video signal by the D / A conversion unit 636, and supplied to the external monitor TV 637. Then, various text information and the like are displayed on the TV 637 together with the main video.
The digital audio output from the audio decoding unit 630 is externally output via the digital output I / F 631, converted into an analog audio signal by the D / A conversion unit 632, and supplied to the external speaker 633.
The operation example of the apparatus of FIG. 1 can be summarized as follows. That is, the analog AV signal input from the A / V input unit 612 is converted into a digital signal by the A / D conversion unit 614. Among the digital signals, a video signal is input to the video encoding unit 616, an audio signal is input to the audio encoding unit 617, and character data such as text broadcast is input to the SP encoding unit 618. The video signal input to the video encoding unit 616 is MPEG-compressed, the audio signal input to the audio encoding unit 617 is AC-3 compressed or MPEG audio-compressed, and character data (bitmap data) input to the SP encoding unit 618 is obtained. ) Is run-length compressed.
Further, from the encoder units 616 to 618, various compressed data are packetized so as to be 2048 bytes when packed, and input to the formatter unit 619. In the formatter unit 619, each packet is packed, further multiplexed, and sent to the D-PRO unit 610.
At this time, for example, if MPEG 1 GOP is set in the encoder unit 601 as a VOBU which is a DVD video data unit, the segmentation information at that time is stored in the buffer memory unit 620. When this segmentation information accumulates to some extent in the buffer memory unit 620, it is transferred to the main MPU unit 604. The main MPU unit 604 creates time map information based on the transferred information. (This time map information is sent at the time of GOP head interrupt, etc.)
Here, as the segmentation information, the size of the VOBU, the playback time from the beginning of the VOBU to the end of the VOBU, the end address of the I picture corresponding to the VOBU, and the like can be considered.
Further, it is also conceivable that the formatter unit 619 directly creates time map information based on the segmentation information and passes it to the main MPU unit 604 in the form of a time map.
The D-PRO unit 610 forms an ECC block by dividing each encoded data pack sequence into 16 packs, attaches error correction data to the ECC block, and attaches the error correction data to the optical disk such as a DVD-RAM by the disk drive unit 609. Record 100.
Here, when the disk drive unit 609 is in a busy state due to a seek or a track jump, the digital signal stream of the ECC block with error correction data is temporarily stored in the temporary storage unit 611 and stored in the disk drive unit 609. You will wait until you are ready to record.
Here, in the real-time DVD recorder of FIG. 1 using a DVD-RAM or the like, still image processing can be performed, for example, as follows.
For example, when a still image video signal is input to the A / V input unit 612 after shifting to the still image recording mode in response to a user instruction from the key input unit 607, the MPEG video encoding unit 616 stores the captured still image data. , It is compressed as I picture data, and a sequence end code is added after the compressed data to convert it into a pack structure. The single I picture data is recorded as 1 VOBU = 1 VOB as shown in FIG.
Further, when a plurality of still images are captured, a group is formed with up to 64 still images, and a VOG (video object group) is formed. This VOG is an administrative delimiter and corresponds to a VOB in the case of moving image reproduction.
For this captured still image, management information (S_AVFI / S_VOGI) is constructed for each VOG, and management information (program chain information) for determining the playback order of the captured multiple still images is registered in ORG_PGCI.
At this time, conditions for forming the VOG will be described later with reference to FIG. 16, but when the number of recordings reaches a certain number (usually 64), or when the recording mode of a still image is changed, When a user presses a grouping key (not shown) (a key included in the key input unit 607 in FIG. 1) (during continuous recording of still images), when a recording date is set, the date changes, etc. Conceivable.
Actually, the VOG is divided by a combination of the above conditions.
Among the above conditions, when the still image recording mode is changed, it means that the resolution of the still image is changed, the audio mono / stereo / dual mono that is played back with the still image, and the still image is changed. It is conceivable to change the compression method of the audio that is played back and the palette data of the sub-picture that is played back with the still image.
Information about these recording mode changes is recorded in management information S_VOB_STI, which will be described later with reference to FIG. 13. By recording a stream information number (S_VOB_STIN) of the corresponding recording mode in S_VOG_GI in FIG. 12, which will be described later. The information regarding the recording mode change can be processed.
FIG. 2 is a diagram for explaining the directory structure of a digital information file recorded on the information medium (DVD-RAM, DVD-RW, DVD-R, HDD, etc.) shown in FIG.
There are a plurality of standards for DVDs, and directories exist for each standard. That is, a VIDEO_TS directory (not shown) is provided for DVD video, an AUDIO_TS 220 directory for DVD audio, and a DVD_RTAV 210 directory for RTR-DVD (recording / playback DVD). The recording data of each standard exists in the file of the corresponding directory.
In DVD video, data is stored in a normal file format. Each title recorded in the DVD video corresponds to, for example, one movie, and one or more titles are included in one disc. A collection of the titles is called a title set, and the title set is composed of a plurality of files.
The title set (VTS) includes a management information file whose information for managing the title set is called video title set information (VTSI), a video file composed of video data, and a VTSI backup file. ing. Further, in DVD video, a management information file called a video manager (VMG) exists as information for managing this disk in one disk.
On the other hand, in the RTR-DVD (recording / playback DVD), as shown in FIG. 2, one video data file VR_MOVIE. VRO file 231 and still image data file VR_STILL. VRO file 232 exists and management information for managing these video data files (video manager VMG) VR_MANGR. An IFO file 230 is recorded.
In the recording / playback DVD standard, the VMGI and VTSI of the DVD video are combined to form overall management information VMG, and video data files are managed by this VMG.
In the RTR-DVD recorder of FIG. 1 according to one embodiment of the present invention, the video file for moving images (VR_MOVIE.VRO231 in FIG. 2) and the data file for still images (VR_STILL.VRO232 in FIG. 2) are stored on one disc. One file each.
The video data file is managed in a hierarchical structure as shown in FIG. 2, one video object set (VOBS) is composed of one or more VOBs, and one VOB is one or more video object units. (VOBU). Each VOBU is composed of a plurality of packs composed of various types of data. One pack is composed of a pack header and one or more packets, and each video data and audio data is recorded in this packet.
FIG. 3 shows a video object set (video, still picture, audio, sub-picture, etc.) included in digital information recorded on the information medium (DVD-RAM, DVD-RW, DVD-R, HDD, etc.) shown in FIG. It is a figure explaining the data structure of VOBS. Information contents such as moving image data, still image data, audio data, and sub-video data are recorded in this VOBS.
Here, as illustrated in FIG. 3, the still image data is managed as one I picture = 1 VOBU = 1 VOB, and after the video data pack (V pack) column, the sub-picture pack (SP pack). ) Row and audio pack (A pack) row. However, in the case of still image data, sub-picture data and / or audio data are optional and may not be present.
Here, a pack is a minimum unit for performing data transfer processing. Further, the minimum unit for performing logical processing is in units of cells, and logical processing is performed in units of cells. The reproduction order of cell data is defined by a program chain (PGC). A plurality of programs (PG) are registered in this PGC, and one or more cells are registered in this PG. It is program chain information (PGCI) included in the VMG that actually records the structure of the PGC. Reproduction processing is performed according to this PGCI, and PGCI is created at the time of recording or editing.
FIG. 4 is a diagram for explaining the data structure of management information (VMG / PGCI / CI) used in the information medium (DVD-RAM, DVD-RW, DVD-R, HDD, etc.) of FIG. In RTR-DVD (recording / playback DVD), management information VMG having a structure as shown in FIG. 4 is used.
In FIG. 4A, RTR video manager information RTR_VMGI describes basic information of the recordable / reproducible optical disc (RTR disc) 100 of FIG. This RTR_VMGI includes a video manager information management table VMGI_MAT and a playlist search pointer table PL_SRTP.
RTR_VMG further includes a movie AV file information table M_AVFIT, a still picture AV file information table S_AVFIT, original PGC information ORG_PGCI, a user-defined PGC information table UD_PGCIT, a text data manager TXTDT_MG, and a manufacturer information table MNFIT.
FIG. 4B shows the data structure of UD_PGCIT in FIG. The UD_PGCIT includes user-defined PCG information table information UD_PGCITI, one or more user-defined PGCI search pointers UD_PGCI_SRP # 1 to UD_PGCI_SRP # n, and one or more user-defined PGC information UD_PGCI # 1 to UD_PGCI # n.
All UD_PGCs are assigned program chain numbers PGCN from 1 to 99 in the order of description of UD_PGCI_SRP in UD_PGCIT. Each PGC can be specified by this PGCN. Here, UD_PGCITI includes UD_PGCI_SRP_Ns indicating the number of UD_PGCI_SRPs and UD_PGCIT_EA indicating the end address of UD_PGCIT.
The maximum value of UD_PGCI_SRP_Ns is set to “99”, for example. UD_PGCIT_EA represents the end address of UD_PGCIT with a relative byte number from the first byte of UD_PGCIT.
Further, UD_PGCI_SRP includes a start address UD_PGCI_SA of UD_PGCI. This UD_PGCI_SA represents the start address of UD_PGCI with a relative byte number from the first byte of UD_PGCIT.
In the recording / playback DVD, a special PGC for cell reproduction in the order of recording is referred to as an original PGC, and information on the original PGC is recorded in ORG_PGCI. A PGC for cell reproduction in an order arbitrarily determined by the user after recording is referred to as user-defined PGC, and information UD_PGCI of one or more user-defined PGCs is recorded in UD_PGCIT. The user-defined PGC does not have its own VOB but is configured to refer to the VOB in the original PGC.
FIG. 4C shows the data structure of ORG_PGCI in FIG. 4A and each UD_PGCI in FIG. Each PGCI contains navigation information for the program chain PGC.
As shown in FIG. 4C, the PGC information (PGCI) includes PGC general information PGC_GI, a program information table PGIT composed of one or more program information PGIs, and a cell information search composed of one or more cell information search pointers CI_SRP. It includes a pointer table CI_SRPT and a cell information table CIT composed of one or more pieces of cell information CI.
FIG. 4D shows the data structure of the cell information table CIT of FIG. This CIT is composed of cell information CI # 1 to CI # j. Here, the start address of each cell information CI can be indicated by CI_SA described by a relative byte number from the first byte of PGCI.
FIG. 4E shows the data structure of each cell information CI in FIG. As shown in the figure, each CI includes cell general information C_GI and one or more cell entry point information C_EPI # 1 to C_EPI # k.
FIG. 5 is a diagram illustrating the contents of cell general information C_GI (still picture cell general information S_C_GI) included in the management information (CI) of FIG.
This C_GI includes a cell type (C_TY) describing the format of the cell, a VOB group still image VOB group information search pointer number (S_VOGI_SRPN) used by this cell, and the number of cell entry point information in this cell. (C_EPI_Ns), the start address (S_S_VOB_ENTN) of the still picture VOB entry number of this cell, and the end address (E_S_VOB_ENTN) of the still picture VOB entry number of this cell.
FIG. 6 is a diagram for explaining the contents of cell entry point information C_EPI (still picture cell entry point information S_C_EPI) included in the management information (CI) of FIG.
This C_EPI includes an entry point type (EP_TY) describing the format of the entry point, an entry number (S_VOB_ENTN) of the still picture VOB, and primary text information (PRM_TXTI). In EP-TY, a flag indicating the presence or absence of PRM_TXTI is described. In S_VOB_ENTN, the number of the start S_VOB is described. In PRM_TXTI, comments and other information related to the corresponding still image can be described.
The recording format of the segmentation information used in the apparatus of FIG. 1 is as shown in FIGS.
FIG. 7 is a diagram for explaining the data structure of still picture management information (VMG / S_AVFIT / S_AVFI / S_VOGI) used in the information medium (DVD-RAM, DVD-RW, DVD-R, HDD, etc.) of FIG. is there.
The VMG in FIG. 7A has the same data structure as the VMG in FIG. The still image AV file information table (S_AVFIT) included in the VMG in FIG. 7A includes still image AV file information table information (S_AVFITI) and still image VOB stream information (S_AVFITI), as shown in FIG. S_VOB_STI # 1 to #n), still image AV file information (S_AVFI), additional audio stream information (S_AA_STI # 1 to #m) for the still image, and additional audio file information (S_AAFI) for the still image. Contains.
Each S_AA_STI in FIG. 7B includes audio attribute information of the additional audio stream.
S_AVFI in FIG. 7B includes S_AVFI general information S_AVFI_GI, still picture VOB group information search pointers S_VOGI_SRP # 1 to #n, and still picture VOB group information S_VOGI # 1, as shown in FIG. 7C. ~ # N.
As shown in FIG. 7D, the S_VOGI in FIG. 7C includes general information S_VOG_GI of the still image VOB group and one or more still image VOB entries S_VOB_ENT # 1 to #n. Each S_VOB_ENT has four types (type A to type D).
FIG. 8 is a diagram for explaining the contents of the still picture video object entry S_VOB_ENT (type A) included in the still picture management information (S_VOGI) in FIG. Type A S_VOB_ENT includes information (S_VOB_ENT_TY) indicating the format of a still picture VOB entry and information (V_PART_SZ) representing the size of a video part in the still picture VOB in units of sectors.
FIG. 9 is a diagram for explaining the contents of the still picture video object entry S_VOB_ENT (type B) included in the still picture management information (S_VOGI) in FIG. Type B S_VOB_ENT includes type A S_VOB_ENT_TY and V_PART_SZ, as well as information (A_PART_SZ) indicating the size of the original (original) audio part in the still image VOB in units of sectors and the playback time of this audio part Information (A_PB_TM) expressed in units of video fields.
When the actual playback time of the audio part does not coincide with the video field boundary, the portion of the end data of the audio part that protrudes from the video field is discarded.
FIG. 10 is a diagram for explaining the contents of the still picture video object entry S_VOB_ENT (type C) included in the still picture management information (S_VOGI) in FIG. The type C S_VOB_ENT corresponds to the type A S_VOB_ENT_TY and V_PART_SZ, the additional audio group number information (S_AAGN) included in the audio stream added to the still picture VOB, and the still picture VOB additional audio stream. And entry number information (AA_ENTN).
FIG. 11 is a diagram for explaining the contents of the still picture video object entry S_VOB_ENT (type D) included in the still picture management information (S_VOGI) in FIG. Type D S_VOB_ENT includes type C S_AAGN and AA_ENTN in addition to type B S_VOB_ENT_TY, V_PART_SZ, A_PART_SZ and A_PB_TM.
The above-described types A to D of S_VOB_ENT both include type A S_VOB_ENT_TY and V_PART_SZ in common.
FIG. 12 is a diagram for explaining the contents of still picture video object group general information S_VOG_GI included in the still picture management information (S_VOGI) in FIG.
The S_VOG_GI includes the number of still picture VOBs registered in the corresponding VOG (S_VOB_Ns), the still picture VOB stream information number (S_VOB_STIN), and time information (FIRST_VOB_REC_TM) when the first VOB in this VOB group is recorded. ), Time information when the last VOB in this VOB group was recorded (LAST_VOB_REC_TM), and a start address (S_VOG_SA) of this VOB group in the still image AF file. This S_VOG_SA expresses a relative address from the head of S_AVFI in units of sectors.
FIG. 13 is a view for explaining the contents of still picture video object stream information S_VOB_STI included in the still picture management information (S_AVFIT) of FIG. The format of the stream information STI updated in the apparatus of FIG. 1 is as shown in FIG.
That is, this S_VOB_STI includes video attribute information V_ATR describing the video encoding scheme of the corresponding still image, audio attribute information OA_ATR describing an optional audio encoding scheme (or attribute of the original audio stream), and sub-picture encoding scheme. The sub-picture attribute information SP_ATR described and the SP_PLT describing the color palette data of the sub-picture are included.
FIG. 14 is a flowchart for explaining the overall recording processing procedure by the apparatus of FIG. In the following, processing during normal still image recording will be described with reference to the flow of FIG.
First, file system data is read from the disk 100 (step ST100), and the free capacity of the disk is checked (step ST102). When there is no free space (NO in step ST102), a warning message such as “no recording space” is output to the display unit 608 and / or the TV 637, and the recording process is terminated.
When the disk 100 has free space (Yes in step ST102), pre-recording processing is performed (step ST110). In this preprocessing, management area writing (VMG file import and creation) and the like are performed.
Next, it is checked whether a still mode for capturing a still image is set by the user from the key input unit 607 or the like (step ST112). If the still mode is not set (NO in step ST112), the process returns to a process such as moving image video recording in the movie mode.
If the still mode has been set (YES in step ST112), the user is allowed to set whether or not to record voice and further set the recording time (step ST114). If there is no voice recording, the user is allowed to set a still time (step ST114). Further, the STC unit 650 is reset, and initial setting of each of the encoding units 616 to 618 is performed (step ST114).
Here, when VMG is recorded on the disc 100, the STI that matches the desired attribute is selected from the stream information STI, and the value of the selected STI is set in each of the encoding units 616 to 618 (steps). ST114).
When the VMG is not recorded on the disc 100, the apparatus (MPU unit 604) in FIG. 1 may generate the VMG and register it in the STI table. This processing is performed not only in the case of still image recording / playback but also in the case of moving image processing. However, in the flow of FIG. 14, this VMG registration (writing) process is performed at the end of recording.
Next, it is checked whether a recording key / REC key (functionally equivalent to a shutter button of a camera) provided in the key input unit 607 in FIG. 1 or a remote controller (not shown) is input (step ST116).
When the recording key / REC key is input (YES in step ST116), the recording start setting is made (step ST118). In this setting, a recording command for one picture (one still image) is set in the video encoding unit 616, and when there is audio recording, a recording time and a recording start command are set in the audio encoding unit 617 (step ST118). ).
Thus, a still picture video signal for one picture is taken into the encoder unit 601, and the taken still picture is compressed and packed, and recorded on the disc 100. At this time, when audio recording is designated, the audio taken in the encoder unit 601 is also compressed, packed, and recorded on the disc 100. The recording addresses of the still images and audio thus packed are determined with reference to the file system (step ST120).
In step ST120, the write size is determined in addition to the write address, and the MPU unit 604 issues a write command to the disk drive unit 609 based on the determined address and size. At the same time as issuing this command, the MPU unit 604 creates VOG information (S_VOGI in FIG. 7D) (step ST120). Based on the created VOG information, a specified number of still images (S_VOB_Ns in FIG. 12) are grouped.
If there is no input of the recording key / REC key (NO in step ST116), the processes in steps ST118 and ST120 are skipped.
Next, it is checked whether or not a recording process end key / STOP key provided in the key input unit 607 in FIG. 1 or a remote controller (not shown) is pressed (step ST122).
If there is no input of the recording process end key / STOP key (NO in step ST122), it is checked whether or not there is a remaining recording capacity on the disc 100 (step ST132).
If disk 100 has a remaining capacity (NO in step ST132), the process returns to step ST116, and the processes in steps ST118 to ST120 are repeated.
If there is no remaining capacity on disc 100 (YES in step ST132), a warning display such as “no recording space” is output on display unit 608 and / or TV 637 (step ST134), and the process proceeds to recording end processing (step ST140).
If the recording process end key / STOP key is input (YES in step ST122), the processes in steps ST132 and ST134 are skipped, and the process proceeds to the recording end process (step ST140).
In the recording end process in step ST140, the VMG file is ended, and the VMG file and the video file are registered and updated in the file system.
Specifically, in this recording end processing, S_AVFIT (including VOG information S_VOGI) and PGCI are completed from the segmentation information and the like, and it is checked whether or not the stream information STI used for recording is in the video manager information VMGI. If this STI is not in the VMGI, the STI used for recording is registered in the VMGI. If this STI is in VMGI, the STI number used for recording is registered in S_VOGI. The formatter unit 619 in FIG. 1 is initialized, and thereafter, PGCI, segmentation information, and the like are written into the VMG (step ST140).
FIG. 15 is a flowchart for explaining the contents of the pre-recording process (step ST110) in the processing procedure of FIG. Hereinafter, pre-processing at the start of recording will be described with reference to the flowchart of FIG.
First, the file system is checked from the volume structure of the disk 100 (step ST1100). If the volume structure is not recorded on disc 100 (NO in step ST1100), a file system is constructed (step ST1102), and a DVD-RTR directory as shown in FIG. 2 is created (step ST1104).
If the volume structure is recorded on disc 100 (YES in step ST1100), the DVD-RTR directory is checked (step ST1106). If there is no DVD-RTR directory (NO in step ST1106), a DVD-RTR directory is created (step ST1108).
If there is a DVD-RTR directory (YES in step ST1106) or a DVD-RTR directory is created (step ST1104 or ST1108), it is checked whether an error has occurred in the file system read from the disc 100. (Step ST1110).
If an error has occurred (YES in step ST1110), a message such as “An error has occurred in the file system” is displayed on the display unit 608 and / or the TV 637 in FIG. 1 (step ST1112), and the process ends or an error occurs. Return to repair (or system restart) processing.
If no error occurs (NO in step ST1110), it is checked whether the management information VMG is in the disk 100 (step ST1114).
If there is no VMG (NO in step ST1114), a VMG is created (step ST1116). The VMG created at this time may be recorded in the management file (VR_MANGR.IFO) of the disk 100, but only developed on the work RAM 604a of the main MPU unit 604 in FIG. Good. In this case, at the end of the recording, the VMG having the updated contents reflecting the recorded contents may be stored in the management file (VR_MANGR.IFO) of the disk 100.
If the VMG is on the disk 100 (YES in step ST1114), the VMG is read from the disk 100 into the work RAM 604a of the main MPU unit 604 (step ST1118).
If no error occurs (NO in step ST1120), the process returns to step ST112 in FIG. If an error occurs (YES in step ST1120), a message such as “Could not create management data” is displayed on the display unit 608 and / or the TV 637 (step ST1122), and the process is terminated or error repair (or system Return to processing.
The timing of performing the pre-recording process in FIG. 15 can be considered as the following three types.
The first method is performed immediately after the disc 100 is loaded into the disc drive unit 609 of FIG. This method has an advantage that recording can be started immediately after the recording key / REC key is pressed. However, when the disc 100 is loaded, it takes a little more preparation time.
The second method is performed when a format button (not shown) of the key input unit 607 is pressed. This method has the disadvantage that the format key must be pressed before recording.
The third is a method of performing at the start of recording. With this method, there is a slight time lag until the start of recording after the recording key / REC key is pressed, and it is necessary to save the recording data during that time in the temporary storage unit 611.
FIG. 16 is a flowchart for explaining the contents of the VOG information creation process (step ST120) in the process procedure of FIG.
First, the number of recorded still image VOB packs, the number of audio packs, the playback time of audio, the presence / absence of sub-picture SP, and the like are fetched as segmentation information and registered in VOB_ENT in FIGS. 8 to 11 (step ST1200).
Next, the conditions for converting a plurality of still images to VOG are checked (step ST1202). The VOG conversion conditions include the following (single or a combination of two or more):
Condition 1: Whether the number of recorded still images has reached a certain number (for example, 64);
Condition 2: If a recording date (time) is set, whether the date (time) has changed (or has reached a specified time);
Condition 3: whether the user manually pressed a VOG switching key (grouping key) (not shown);
Condition 4: Whether the still image recording mode has been changed (whether the still image source attribute has changed);
If any one or more of the above conditions 1 to 4 is satisfied (the condition in step ST1202 is applicable), the VOG is closed, and various information (the number of still images VOB registered in the corresponding S_VOG, the attribute of the VOG) is stored in S_VOG_GI in FIG. The number of the stream information STI that matches the information, the recording start time of the first VOB, the recording start time of the last VOB, and the like are registered (step ST1204).
If none of the above conditions 1 to 4 is satisfied (not applicable in step ST1202), the process in step ST1204 is skipped.
FIG. 17 is a flowchart for explaining the contents of post-recording processing (step ST140) in the processing procedure of FIG. This process is performed in common for moving images / still images.
First, the main MPU unit 604 updates the VMG in the work RAM 604a based on the segmentation information received from the formatter unit 619 (step ST1400).
Next, it is checked whether or not the attribute data used for recording is in the stream information STI table in the VMG (step ST1402). If the attribute data exists in the STI table (Yes in step ST1402), the STI number is registered in M_VOBI (in the case of a moving image) or S_VOGI (in the case of a still image) (step ST1404).
If the attribute data does not exist in the STI table (NO in step ST1402), it is checked whether the number of recorded STIs has reached the maximum value (that is, whether there is free space in the STI table) (step ST1406). If the number of STIs has not reached the maximum value (that is, there is a free space in the STI table) (NO in step ST1406), the STI information used for recording is registered in the STI table, and M_VOBI (in the case of a moving image) or S_VOGI In the case of a still image, the newly registered STI number is registered (step ST1408).
If the number of STI has reached the maximum value (that is, there is no free space in the STI table) (YES in step ST1406), the registered M_VOBI (in the case of a moving image) or S_VOGI (in the case of a still image) is examined and used. It is checked whether there is any STI that has not been received (step ST1410). If there is an unused STI (Yes in step ST1410), the registration of unused STI information is deleted to secure a new STI, and the STI information used for recording is registered in the reserved STI (step S1410). ST1412), the process proceeds to step ST1408. In step ST1408, the STI number registered in step ST1412 is registered.
If there is no unused STI (NO in step ST1410), an error is displayed on the display unit 608 and / or TV 637 in FIG. 1 (step ST1414), and the process in FIG.
When an STI number is registered in M_VOBI (for a moving image) or S_VOGI (for a still image) (step ST1404 or ST1408), a VRO file (VOBS file) is stored in the directory record information under the DVD_RTAV directory (FIG. 2) in the file system Is checked (step ST1416).
If the VRO file (VOBS file) exists (YES in step ST1416), the directory record is updated by updating the information of the VRO file (VOBS file) (to the information of the recorded video file) (step ST1418). . If the VRO file (VOBS file) does not exist (NO in step ST1416), the directory record information of the VRO file (VOBS file) is additionally registered (to the recorded video file information) (step ST1420).
When the directory record information is updated (step ST1418) or registered (step ST1420), VR_MANGR.V is stored in the directory record information under the DVD_RTAV directory (FIG. 2). It is checked whether there is an IFO file (VMG file) (step ST1422).
VR_MANGR. If there is an IFO file (VMG file) (YES in step ST1422), the VMG information in the work RAM 604a is written at the position of this IFO file, and the directory record information under the DVD_RTAV directory is updated (step ST1424).
VR_MANGR. If there is no IFO file (VMG file) (NO in step ST1422), the VMG information built in the work RAM 604a is recorded in the free area of the disc 100, and the IFO file information is additionally registered in the directory record information under the DVD_RTAV directory. (Step ST1426).
Note that the processing relating to the stream information STI in FIG. 17 can also be performed before recording.
18 to 20 are flowcharts for explaining the processing procedure of still image continuous capture recording by the apparatus of FIG.
First, file system data is read from the disk 100 (step ST200), and the free capacity of the disk is checked (step ST202). When there is no free space (NO in step ST202), a warning display such as “no recording space” is output to the display unit 608 and / or the TV 637, and the recording process is terminated.
When the disk 100 has free space (Yes in step ST202), pre-recording processing is performed (step ST110). In this pre-processing, a VMG file is taken in and each set value (PGCI, S_VOGI, etc.) is stored in the work RAM unit 604a of the main MPU unit 604.
Next, it is checked whether or not a slide show capture mode in which a plurality of still images are continuously captured by the user from the key input unit 607 or the like is set (step ST212). If the slide show capture mode is not set (NO in step ST212), the process returns to another process.
If the slide show capture mode is set (Yes in step ST212), the user is allowed to set the presence / absence of voice recording and further set the voice recording time (including unlimited time) (step ST214). When not recording audio, the user is allowed to set a still time (step ST214). The set maximum recording time (or time unlimited state) or still time is stored in the work RAM unit 604a. Further, the STC unit 650 is reset, and initial setting of each of the encoding units 616 to 618 is performed (step ST214).
In this initial setting, a still image recording mode (I picture still recording mode), a VOG separation mode, an audio recording time, and the like are set. In addition, the stream information STI data in the work RAM unit 604a is checked, and if there is a match with the attribute information of the data to be recorded, the STI number is stored in the work RAM unit 604a. If there is no data that matches the attribute information of the data to be recorded, the attribute information of the data to be recorded is stored in the work RAM unit 604a as an STI.
Further, in the initial setting in step ST214, the user is caused to set the recording date and time at the time of slide show shooting, which is saved in the work RAM unit 604a and set in the formatter unit 619 (step ST214). In addition, when the user setting of the recording date / time is not made, the date / time of capturing is set.
Further, in the initial setting in step ST214, the user is made to specify the number of frames to start capturing after the video change (step ST214). The number of frames to start capturing specifies how many frames of video are to be captured after the video has changed, but if not specified, the video frame immediately after the change is captured. (However, when a method of detecting and capturing that a certain number of frames have continued after the change is employed, it is not necessary for the user to specify the number of frames.)
Here, the number of frames that indicate the number of frames to be captured after the video changes is specified by performing effect processing such as fade-in and fade-out when slide show playback is performed with an electronic still camera or the like. This is to cope with a case where the frame is being faded in (in order not to capture a frame that is being faded in or faded out).
Instead of specifying the number of frames as described above, it is also conceivable to detect that a certain number of the same video frames continue after the detection of the frame change, and capture the frame data using the detected signal as a trigger.
Subsequently, an input check of a slideshow import start key (not shown) provided in the key input unit 607 of FIG. 1 or a remote controller (not shown) is performed (step ST216).
If there is a start key input (YES in step ST216), a recording start setting is made for the encoder unit 601 (step ST218). In this setting, a setting for encoding one frame (or one field) as an I picture, and if audio encoding is set, the audio encoding unit 617 is designated to start audio encoding and the maximum recording time or no time limit. Settings are made.
After the recording start setting is made in step ST218, a recording end key input check (step ST222), a recording time lapse check (step ST224), and a video content change check (step ST226) are performed.
If no recording end key is input (NO in step ST222), the set maximum recording time has not elapsed (NO in step ST224), and no change has occurred in the video content (NO in step ST226). It is checked whether or not the encoded data amount (data amount compressed and packed by the formatter unit 619) is stored in the buffer memory unit 620 (step ST228). When the amount of encoded data stored in the buffer memory unit 620 has not reached a certain amount (NO in step ST228), the processing loop of steps ST222 to ST228 is repeated until it reaches the certain amount.
When the amount of encoded data stored in the buffer memory unit 620 reaches a certain amount (Yes in step ST228), the write address and data size of the certain amount of data (pack) are determined by the file system, and this is determined by the disk drive unit 609. The data is written on the disk 100 (step ST230).
At the time of writing, it is checked whether or not there is a remaining capacity for recording on the disc 100 (step ST232). If there is remaining capacity on disk 100 (NO in step ST232), the process returns to step ST222, and the processes in steps ST222 to ST230 are repeated.
If there is no remaining capacity on disc 100 (YES in step ST232), a warning message such as “no remaining capacity” or “no recording space” is output on display unit 608 and / or TV 637 (step ST234), and the recording shown in FIG. The process proceeds to an end process (step ST140). Note that if the recording end key is input in step ST222 (YES in step ST222), the process proceeds to the recording end process (step ST140) in FIG.
When the maximum recording time set in step ST224 has elapsed (YES in step ST224), or when the video content has changed in step ST226 (YES in step ST226), the process proceeds to step ST220 in FIG.
In step ST220, an encoding end command is issued to the audio encoding unit 617. Then, the data encoded so far is read from the buffer memory unit 620 and written to the disc 100 (its write address and data size, that is, the amount of unrecorded remaining data is determined by the file system). The number of packs of VOBU (FIG. 3) and the like are stored in the work RAM unit 604a as segmentation information (VOBI information). Further, when a new grouping becomes necessary due to the upper limit of the number of still images in one group or a change in the attributes of still images, VOG division is performed, and the VOG information (S_VOGI) is created, and the work RAM Stored in the unit 604a.
Thereafter, the process waits until a change in the video content occurs (YES in step ST236), and waits until a specified number of frames elapses after the change in the video content occurs (YES in step ST238). Then, returning to step ST218 in FIG. 18, the captured slide show still image group is written onto the disc 100 by the processing loop of steps ST222 to ST232.
After detecting a change in video content in step ST236, it is checked in step ST238 whether or not a predetermined number of video frames having the same content continue, and if a predetermined number of video frames having the same content continue (YES in step ST238), FIG. It can also be configured to return to step ST218.
In the process of FIG. 18, when a recording end key is input (Yes in step ST222) or a warning display such as “no remaining capacity” is output (step ST234), the recording end process (step ST140) of FIG. After the execution, the processes in FIGS. 18 to 20 are terminated.
In this recording end processing (step ST140; corresponding to ST140 in FIG. 14),
* Carving information (S_VOGI etc.) is configured,
* It is investigated whether or not the stream information STI used for recording is in VMG. If not, the STI used for recording is registered. If there is, the corresponding STI number is registered in S_VOGI.
* Formatter unit 619 is initialized,
* Recording information (PGCI setting, segmentation information, etc.) is written to the VMG file (VMG update).
18 to 20 described above can easily realize continuous capture of still images without burdening the user with troublesome operation.
FIG. 21 is a flowchart for explaining the entire reproduction processing procedure by the apparatus of FIG.
First, the disk 100 loaded in the disk drive unit 609 in FIG. 1 is checked (step ST300). If the disk 100 is defective or is a standard disk that cannot be supported by the system of FIG. 1 (NG in step ST300), error processing is performed (step ST302), and the processing in FIG. 21 ends.
If the disc 100 is normal (OK in step ST300), it is checked whether a volume structure is recorded on the disc (step ST304). If the volume structure is recorded (YES in step ST304), the existence of the DVD_RTR directory (FIG. 2) is checked (step ST306).
If there is no DVD_RTR directory (NO in step ST306) or if the volume structure has not been recorded (NO in step ST304), a message such as “Not recorded” is displayed (step ST308), and then FIG. The process ends.
If there is a DVD_RTR directory (Yes in step ST306), it is checked whether or not an error has occurred (step ST310). When an error occurs (YES in step ST310), a message such as “An error has occurred in the file system” is displayed (step ST312), and the processing in FIG. 21 ends.
If there is no error (NO in step ST310), it is checked whether there is a VMG file on the disk 100 (step ST314). If there is a VMG file (YES in step ST314), the contents of the VMG file are read (step ST318), and VR_MOVIE. VRO, VR_STILL. VRO, VR_AUDIO. It is checked whether there is a VRO file such as VRO (step ST320).
If there is no VRO file (NO in step ST320) or no VMG file (NO in step ST314), a message such as “Not recorded” is displayed (step ST316), and the processing in FIG. 21 ends. To do.
If there is a VRO file (YES in step ST320), the program number and cell number for starting reproduction are selected and determined by the user or the like (step ST322).
When the program number and cell number to start reproduction are determined, initial settings of the video decoding unit 628, SP decoding unit 627, and audio decoding unit 630 in FIG. 1 are performed (step ST324). In this initial setting, the video decoding unit 628 is set to a still picture playback mode (still picture mode), and performs I picture playback of MPEG video ignoring the STC unit 650.
Thereafter, cell reproduction processing for still images and the like is started (step ST330). Details of the cell reproduction processing will be described later with reference to FIGS. 22 and 23.
While cell playback is continuing (NO in step ST332), the next playback cell is set from PGCI (step ST334), and the cell playback processing in step ST330 is repeatedly executed.
When cell playback is completed (Yes in step ST332), the occurrence of an error is checked (step ST336). If there is no error (No in step ST336), other processing at the end of reproduction is performed (step ST338), and then the processing in FIG. If there is an error (Yes in step ST336), a message such as “A reading error has occurred” is displayed (step ST340), the playback end processing is executed (step ST342), and other processing routines are executed. Return.
22 and 23 are flowcharts for explaining specific processing contents of the processing (step ST330) during cell playback in the processing procedure of FIG.
22, the start position (FP) of the cell to be reproduced is determined from the contents of PGCI in FIG. 4 and S_AVFIT in FIG. 7 (step ST3300). This position (FP) is represented by a logical block number (LBN).
In the process of step ST3300, the number of the video object VOB to start playback is set to the parameter “n”, the stream information STI of the video object group VOG to be played back is read into the work RAM unit 604a, and these are decoded by each decoding unit 627 ~ 630.
Next, the temporary erase flag indicating the temporarily erased state is attached to the VOB to be reproduced, and it is checked whether or not the flag is on (step ST3302). The temporary erase flag on state corresponds to, for example, a state in which the file of the corresponding VOB is discarded in the trash can icon.
Although the temporary erase flag on VOB has not yet been actually erased, it is removed from the reproduction target. If the temporary erase flag of the current VOB is on (YES in step ST3302), the process jumps to step ST3336 of FIG.
If the temporary erase flag of the current VOB is off (NO in step ST3302), the nth to be reproduced is determined from the contents of PGCI and S_AVFIT (stream information STI including the VOB number n to be reproduced and video / audio attribute information). The VOB start position (FP) is determined (step ST3304).
Next, it is determined whether the determined entry type VOB_ENT of the nth VOB is one of type A to type D in FIGS. 8 to 11 (step ST3310).
If VOB_ENT is type A, still time (still image display time) information (STILL_TM) (not shown) is read from RTR_VMGI in FIG. 4A and set (step ST3312), and data is read to the disk drive unit 609. An instruction is set (step ST3324).
If VOB_ENT is type B, the still time is set to 0xFFFF (audio playback time), and the audio superimposed on the still image is set to be played back (step ST3314). Then, after the reproduction start time stamp PTS at the start of audio is set in the STC unit 650 (step ST3322), a data read command is set in the disk drive unit 609 (step ST3324).
When VOB_ENT is type C, the still time is set to 0xFFFF (audio playback time), and additional audio (additional audio AA) is set to be played back (step ST3316). At this time, the transfer end address of the corresponding VOB is set to be only the video part. Then, a process transfers to step ST3322.
When VOB_ENT is type D, it is first checked whether additional audio is selected (step ST3318). If additional audio is selected (YES in step ST3318), the process proceeds to step ST3316. If no additional audio is selected (NO in step ST3318), the still time is set to 0xFFFF (audio playback time), and the audio superimposed on the still image is set to be played back (step ST3320). Then, a process transfers to step ST3322.
In FIG. 22, when a data read command is set in the disk drive unit 609 (step ST3324), the process proceeds to step ST3326 in FIG. In step ST3326, it is checked whether data transfer to the disk drive unit 609 has been started.
When data transfer is started (YES in step ST3326), it is checked whether additional audio data is also transferred (step ST3328).
When transferring additional audio data (YES in step ST3328), the additional audio start position (FP) and end position (FP) attached to the nth VOB_ENT to be reproduced are determined from the contents of PGCI and S_AVFIT. (Step ST3330).
Thereafter, the start position (FP) and the end position (FP) are converted into physical addresses by the file system, and a data read command is set in the disk drive unit 609 based on the physical address data (step ST3332).
When the transfer of the data read out by the disk drive unit 609 is completed in this manner (YES in step ST3334), it is checked whether there is any user key input from the key input unit 607 or a remote controller (not shown) (step ST3336).
If there is a stop key input from the user (YES in steps ST3336 and ST3338), the process returns to the reproduction stop process. If there is no key input from the user (NO in step ST3336) and the playback time has not ended (NO in step ST3342), the processing loop of steps ST3336 and ST3342 is repeated. Note that the determination in step ST3342 is made based on whether or not the playback time has ended during audio playback, and whether or not the still time (still image playback time) has ended in other playbacks.
On the other hand, when there is a play key input instead of a stop key input from the user (yes in step ST3336, no ST3338, yes in ST3340), or when the playback time ends in step ST3342 (yes in step ST3342), step ST3300 in FIG. The parameter “n” set in step 1 is incremented (step ST3344).
If “n” thus incremented is within the total number of pictures in the cell (NO in step ST3346), the process returns to step ST3302 in FIG. 22 and the processes of ST3302 to ST3346 are repeated.
On the other hand, when the incremented “n” exceeds the total number of pictures in the cell (YES in step ST3346), the reproduction processing in FIGS. 22 and 23 ends, and the process returns to other processing.
As described above, according to the present invention, a still image continuous capturing function that allows a user to easily and continuously capture a plurality of still images from a video signal without the user having to select and set each captured still image one by one. An attached digital video information apparatus can be obtained.
Further, it is possible to obtain a multiple still image recording method in which a plurality of still images can be easily and continuously recorded from a video signal without the user having to select and set each captured still image one by one.
The block diagram explaining the whole structure of the digital video information apparatus (RTR-DVD video recorder) with a still image continuous taking-in function which concerns on one embodiment of this invention. The figure explaining the directory structure of the digital information file recorded on the information medium (DVD-RAM, DVD-RW, DVD-R, HDD etc.) of FIG. FIG. 2 is a view for explaining the data structure of a video object set (VOBS) included in digital information recorded on the information medium (DVD-RAM, DVD-RW, DVD-R, HDD, etc.) of FIG. 1. The figure explaining the data structure of the management information (VMG / PGCI / CI) used with the information medium (DVD-RAM, DVD-RW, DVD-R, HDD, etc.) of FIG. The figure explaining the content of the cell general information C_GI contained in the management information (CI) of FIG. FIG. 5 is a diagram for explaining the contents of cell entry point information C_EPI included in the management information (CI) of FIG. 4. FIG. 3 is a view for explaining the data structure of still picture management information (VMG / S_AVFIT / S_AVFI / S_VOGI) used in the information medium (DVD-RAM, DVD-RW, DVD-R, HDD, etc.) of FIG. 1; The figure explaining the content of the still picture video object entry S_VOB_ENT (type A) contained in the still picture management information (S_VOGI) of FIG. The figure explaining the content of the still picture video object entry S_VOB_ENT (type B) contained in the still picture management information (S_VOGI) of FIG. The figure explaining the content of the still picture video object entry S_VOB_ENT (type C) contained in the still picture management information (S_VOGI) of FIG. The figure explaining the content of the still picture video object entry S_VOB_ENT (type D) contained in the still picture management information (S_VOGI) of FIG. The figure explaining the content of the still picture video object group general information S_VOG_GI contained in the still picture management information (S_VOGI) of FIG. The figure explaining the content of the still picture video object stream information S_VOB_STI contained in the still picture management information (S_AVFIT) of FIG. The flowchart figure explaining the whole video recording processing procedure by the apparatus of FIG. The flowchart figure explaining the content of the video recording pre-process in the process sequence of FIG. The flowchart figure explaining the content of the VOG information creation process in the process sequence of FIG. The flowchart figure explaining the content of the post-recording process in the process sequence of FIG. The flowchart figure explaining the process sequence (the 1) of the still image continuous taking recording by the apparatus of FIG. The flowchart figure explaining the process sequence (the 2) of the still image continuous taking recording by the apparatus of FIG. The flowchart figure explaining the process sequence (the 3) of the still image continuous capture recording by the apparatus of FIG. The flowchart figure explaining the whole reproduction | regeneration processing procedure by the apparatus of FIG. The flowchart figure explaining the process sequence (the 1) at the time of the cell reproduction | regeneration in the process sequence of FIG. The flowchart figure explaining the process sequence (the 2) at the time of the cell reproduction | regeneration in the process sequence of FIG.
DESCRIPTION OF SYMBOLS 100 ... Optical disk / information storage medium (DVD-RAM, DVD-RW, DVD-R and other recordable / reproducible information media); 601 ... Encoder unit; 602 ... Decoder unit; 604 ... Main MPU unit; 604b ... Kanji ROM (character ROM) part; 604c ... Program ROM part; 6041 ... Directory detection part; 6043 ... Video object grouping (VOG) part; 605 ... Video mixing part; 606 ... Frame memory part; 608 ... Display unit; 609 ... Disk drive unit; 610 ... Data processor (D-PRO) unit; 611 ... Temporary storage (buffer) unit; 612 ... A / V input unit; 613 ... TV tuner unit; / D conversion unit; 616 ... video encoding unit; 617 ... audio encoding 618 ... Sub-picture (sub-picture SP) encoding section; 619 ... Formatter section; 620 ... Buffer memory section; 625 ... Separating section; 626 ... Memory; 627 ... Sub-picture (SP) decoding section; 628 ... Video decoding section; ... reduced image (thumbnail picture) generation unit; 630 ... audio decoding unit; 631 ... digital output I / F (for audio); 632 ... D / A conversion unit (for audio); 633 ... external speaker; / F (for video); 636 ... D / A converter (for video); 637 ... external monitor TV; 638 ... video processor (V-PRO) section; 650 ... system time clock (STC) section; 700 ... hard disk drive (HDD) Recorder unit.
For recording video information including still images in a data format of a predetermined format on a recordable / reproducible information medium,
Mode designation means for designating a still image continuous capture mode for continuously capturing still images;
Video information receiving means for receiving video information including one or more still image information;
When the still image continuous capture mode is specified by the mode specifying means, the video content of the video information received by the video information receiving means is checked, and if the video content changes, the change is detected. Image change detection means;
Encoding means for encoding still image information of one frame or one field corresponding to the video content detected by the video change detecting means into an MPEG I picture;
A digital video information apparatus comprising: data format conversion means for converting digital information including an I picture encoded by the encoding means into a data format of the predetermined format.
For recording video information including a plurality of still images in a data format of a predetermined format on an information medium having a data recording area and a management information recording area,
Set a still image group of multiple still images within a predetermined number of images;
After starting recording of the video information, recording the plurality of still images included in the video information is continuously performed on the data recording area of the information medium,
Create management information for collecting the recorded still images for each still image group,
The multiple still image recording method, wherein the created management information is written in a management information recording area of the information medium on which the plurality of still images are recorded.
JP2004246501A 2004-08-26 2004-08-26 Digital video information apparatus and method with consecutive still image capturing function Pending JP2005020778A (en)
JP2004246501A JP2005020778A (en) 2004-08-26 2004-08-26 Digital video information apparatus and method with consecutive still image capturing function
JP2000284177 Division
JP2005020778A true JP2005020778A (en) 2005-01-20
ID=34191736
JP2004246501A Pending JP2005020778A (en) 2004-08-26 2004-08-26 Digital video information apparatus and method with consecutive still image capturing function
JP (1) JP2005020778A (en)
CN103839037A (en) * 2012-11-23 2014-06-04 华中科技大学 Network video-stream unhealthy-content detection method and system based on many cores and GPU
2004-08-26 JP JP2004246501A patent/JP2005020778A/en active Pending
CN103839037B (en) * 2012-11-23 2016-12-21 华中科技大学 A kind of network video stream harmful content detection method based on many-core and GPU and system
JP4581022B2 (en) 2010-11-17 Information storage medium for recording stream data, recording method, reproducing method, and reproducing apparatus
US6553181B2 (en) 2003-04-22 Optical disc for storing moving pictures with text information and apparatus using the disc
US6907187B2 (en) 2005-06-14 Information recording method, information reproducing method, and information recording/reproducing medium
US20030059210A1 (en) 2003-03-27 Information recording method and information reproducing method
US20040247293A1 (en) 2004-12-09 Information recording medium, information recording method and apparatus, and information playback method and apparatus