Source: https://patents.google.com/patent/KR101499194B1/en
Timestamp: 2019-10-17 09:37:28
Document Index: 745786631

Matched Legal Cases: ['art 100', 'art 105', 'art 100', 'art 100', 'art 105', 'art 110', 'art 285', 'art 285', 'art 285', 'art 285', 'art 285', 'art 285', 'art 490', 'art 495', 'art 497', 'art 490', 'art 497', 'art 490', 'art 490', 'art 490', 'art 699', 'art 693', 'art 693', 'art 893', 'art 893', 'art 899', 'art 893', 'art 893']

KR101499194B1 - Method for Adaptive Streaming - Google Patents
Method for Adaptive Streaming Download PDF
KR101499194B1
KR101499194B1 KR1020140035629A KR20140035629A KR101499194B1 KR 101499194 B1 KR101499194 B1 KR 101499194B1 KR 1020140035629 A KR1020140035629 A KR 1020140035629A KR 20140035629 A KR20140035629 A KR 20140035629A KR 101499194 B1 KR101499194 B1 KR 101499194B1
KR1020140035629A
KR20140048917A (en
권봉기
주식회사 비즈모델라인
2014-03-26 Application filed by 주식회사 비즈모델라인 filed Critical 주식회사 비즈모델라인
2014-03-26 Priority to KR1020140035629A priority Critical patent/KR101499194B1/en
2014-04-24 Publication of KR20140048917A publication Critical patent/KR20140048917A/en
2015-03-17 Publication of KR101499194B1 publication Critical patent/KR101499194B1/en
According to the adaptive streaming method of the present invention, a method is implemented in a terminal for streaming content through a communication network, the method comprising: index information for indexing N (N> 1) intervals divided from the content; (I) a plurality of data chunks each having a different unit of i (i> 1) in each of the sections, a communication link is established with a server managing a storage medium, and data to be streamed (N &gt; = 1) -th order of the data chunks satisfying the determined index, and transmits to the server a data chunk corresponding to a unit to be streamed out of the i units of the data chunks corresponding to the confirmed index So as to be streamed.
[0001] The present invention relates to an adaptive streaming method,
The present invention provides a method for performing content streaming on a terminal through a communication network, the method comprising the steps of: index information for indexing N (N> 1) intervals divided from the content; (N > = 1) of contents to be streamed out of data chunks stored in the storage medium, by checking a communication connection with a server managing a storage medium storing a plurality of data chunks having different units 1) th data chunk, and for requesting a data chunk corresponding to a unit to be streamed among the i units of the data chunks corresponding to the confirmed index to the server, Type streaming method.
Most multimedia contents are generated by encoding predetermined video / audio data by encoding an analog video / audio signal inputted from the original image acquiring device and storing the video / audio data according to various multimedia content file structures do.
In general, the encoding of the video / audio signal includes a predetermined compression codec including an integrated compression method, and the multimedia contents file structure includes a file structure capable of accommodating the compressed codec.
In addition, the multimedia contents can be divided into a file structure capable of real time streaming according to the encoding and compression codec scheme of the video / audio signal and the multimedia contents file structure, and a file structure in which real time reproduction is impossible.
Here, the file structure capable of real-time playback may be configured such that, in transmitting multimedia contents through a predetermined communication network, the file structure preferentially transmits various header information constituting the multimedia contents and index information necessary for multimedia contents reproduction, / Audio data corresponding to the audio / video data, or transmits various kinds of header information constituting the multimedia contents, and then transmits the video data corresponding to the video / audio data of the multimedia contents, And a structure for transmitting together index information necessary for content reproduction.
On the other hand, in the file structure in which the real-time reproduction is not possible, in transmitting multimedia contents through a predetermined communication network, it is preferable to transmit various kinds of header information constituting the multimedia contents preferentially, And a structure for transmitting the index information necessary for reproducing the multimedia contents last.
[0002] Recently, as information and communication technologies have rapidly developed, many technical constraints (e.g., computation speed, communication speed, etc.) for file transmission and reception through a communication network have been eliminated, , Low capacity / high picture quality, etc.) have been developed and distributed. The compressed codec is mainly used in an AVI (Audio Video Interleaving) file using a video / audio synchronization technology of Microsoft Corporation, And most multimedia contents transmitted and received through a communication network include the AVI file structure.
1 is a diagram illustrating a multimedia contents structure according to a conventional AVI file structure.
More specifically, FIG. 1 illustrates the structure of the AVI file based on reference data provided in a MSDN (MicroSoft Developer Network) distributed by Microsoft Corporation of America for developers.
1, the multimedia content conforming to the AVI file structure includes a header part 100 including predetermined content header information, a video data part 105 including predetermined video / audio data, And an index unit 110 including index information necessary for reproducing the content. The preferred structure of the index unit 110 is as follows.
RIFF ('AVI'
'avih' (<Main AVI Header>)
'strh' (<Stream header>)
'strf' (<Stream format>)
'strd' (<additional header data>)
'strn' (<Stream name>)
{SubChunk | LIST ('rec'
['idx1' <AVI Index>]
The header part 100 of the multimedia content is located after the FOURCC character code of the multimedia content and includes a main header and a stream header .
The main header includes predetermined header information for the entire multimedia contents, and is defined through a MainAVIHeader structure. The MainAVIHeader structure includes frame rate information (dwMicroSecPerFrame), data rate information (dwMaxBytesPerSec), flag information dwFlags, dwTotalFrames, dwInitialFrames, and stream information dwStreams for the multimedia contents , Buffer size (dwSuggestedBufferSize), and horizontal / vertical resolution information (dwHeight, dwReserved), and the like. Preferably, the main header information includes the following structure format .
DWORD dwReserved [4];
} MainAVIHeader;
The stream header ('strh') is located after the main header and is defined by an AVIStreamHeader structure. In addition, a stream format ('strf') is defined after the stream header, which is differently defined according to the stream format. If the stream format is a video stream, the stream format is defined by a BITMAPINFO structure including predetermined palette information, and if the stream format is an audio stream, the stream format is defined by a WAVEFORMATEX structure.
The stream header may additionally include stream header data ('strd') and stream name ('strn'), wherein the stream header data ('strd') defines a CODEC for the stream format, The stream name ('strn') includes a NULL-terminated stream name string.
The image data unit 105 preferably comprises a plurality of chunks configured by a predetermined data unit by interleaving predetermined video data and audio data, and the image data unit 105 may include the image data (e.g., And audio data) are reproduced in the chunk unit.
The video data unit 105 may include at least one data chunk directly described in the video data unit 105 ('movi') and at least one data chunk grouped into a predetermined record chunk ('rec') Wherein each data chunk includes a predetermined second character code (fourcc), wherein the first character code included in the data chunk includes a 2-digit stream number and a 2-digit stream format (db = uncompressed video frame, dc = compressed video frame, pc = palette change, wb = audio data).
The index unit 110 is located after the image data unit 105 and includes a list of the data chunks and positional information in the file, and is defined by an AVIINDEXENTRY structure.
Preferably, the AVIINDEXENTRY structure includes a predetermined chunk identifier ckid, flag information dwFlags, a chunk offset dwChunkOffset, and a chunk size dwChunkLength, It is preferable to include the following structure type.
DWORD ckid;
DWORD dwChunkOffset;
} AVIINDEXENTRY;
That is, in transmitting the multimedia contents conforming to the AVI file structure through a predetermined communication network, the multimedia contents may include a header part 100, an image data part 105 and an index part 110 sequentially The apparatus (or terminal) for reproducing the multimedia contents may not reproduce the multimedia contents until the index unit 110 is received (or until the reception of the multimedia contents is completed) .
An object of the present invention is to provide a method that is executed in a terminal for streaming content through a communication network, the method comprising: index information for indexing N (N> 1) intervals divided from the content; a first step of confirming a communication connection with a server managing a storage medium storing a plurality of data chunks having different units (i > 1) A second step of checking an index of a data chunk corresponding to the n-th (n &gt; = 1) order and a data chunk corresponding to a unit to be streamed out of i units of data chunks matching the confirmed index, And a third step of processing the streaming request so as to request the streaming method.
According to another aspect of the present invention, there is provided a method for performing streaming of content through a communication network, the method comprising: index information for indexing N (N> 1) intervals divided from the content; A first step of confirming a communication connection with a server managing a storage medium storing a plurality of data chunks having i (i> 1) different units for each section, A second step of checking an index of a data chunk conforming to the n-th (n &gt; = 1) order of the contents to be streamed, and a step of storing data corresponding to a unit to be streamed out of i units of data chunks matching the checked index And a third step of requesting a chunk to the server and processing the chunk to be streamed.
In the adaptive streaming method according to the present invention, the method may further include receiving information on contents to be streamed from the server and information on data chunks of the contents to be streamed.
In the adaptive streaming method according to the present invention, it is preferable that the method further comprises the step of identifying a unit capable of streaming seamlessly among the i different units.
In the adaptive streaming method according to the present invention, the i different units include a unit in which at least one of a frame rate, a data rate and a capacity of data chunks are different from each other.
In the adaptive streaming method according to the present invention, the third step may include requesting, from the server, a data chunk corresponding to a unit that can seamlessly be streamed to the terminal among i units of data chunks matching the index So as to be streamed.
In the adaptive streaming method according to the present invention, the step of confirming the communication performance of the terminal and the step of determining a unit capable of seamlessly streaming to the terminal among i different units based on the communication performance of the terminal And further comprising:
In the adaptive streaming method according to the present invention, the method further includes a step of determining a request for a data chunk corresponding to the (n + 1) th order to be streamed next based on the reception capacity of the data chunk streamed from the server .
In the adaptive streaming method according to the present invention, a step of checking an index of a data chunk corresponding to the (n + 1) th order to be streamed next in data chunks stored in the storage medium, And requesting the server for data chunks corresponding to a unit to be streamed among the i units of the data chunks to be streamed.
In the adaptive streaming method according to the present invention, a step of checking an index of a data chunk corresponding to the (n + 1) th order to be streamed next in data chunks stored in the storage medium, And requesting, from the server, data chunks corresponding to a unit capable of streaming seamlessly among the i units of the data chunks to be streamed.
In the adaptive streaming method according to the present invention, the unit to be streamed includes at least one unit among units set in the terminal and units confirmed based on communication performance of the terminal.
A method for real-time content playback according to the present invention is a real-time content playback method executed in a terminal for streaming content through a communication network, the method comprising: generating a plurality of data chunks (Data Chunks) (I > 1) index information for requesting streaming of n-th (n > 1) data chunks to a server for storing information, And requesting the server to transmit the n-th data chunk in units of the n-th data chunks identified by the i-th index information, the n-th data chunks corresponding to the determined unit information to be streamed Wherein the unit information includes information indicating that the n-th data chunk is seamlessly streamed in a situation of the UE The data rate, the chunk information, and the capacity information.
The method may further include confirming information about a content to be streamed through a server that stores a plurality of data chunks for each unit in the real-time content reproducing method according to the present invention.
The method may further include determining whether to stream the (n + 1) -th data chunk based on the reception capacity of the n-th data chunk streamed from the server, in the real-time content playback method according to the present invention .
(I + 1) th index information for requesting a (n + 1) -th data chunk to be streamed to the server, and (i + (N + 1) th data chunk identified by the (i + 1) th index information to the server; (N + 1) th data chunk in units of the data chunks conforming to the identified unit information, and processing to receive streaming data, wherein the unit information includes the (n + 1) th data chunk Data rate, chunk information, and capacity information for streaming data chunks seamlessly.
In the real-time content reproducing method according to the present invention, it is preferable that the method further comprises confirming the configuration information of the streamed content, wherein the i-th index information is confirmed based on the configuration information of the content.
In the real-time content reproducing method according to the present invention, it is preferable that the method further comprises confirming the communication performance of the terminal, and the unit information is confirmed based on the communication performance of the terminal.
A method for reproducing multimedia contents according to the present invention includes the steps of repeatedly checking storage capacity information of multimedia contents to be received when reproducing predetermined multimedia contents, Extracting configuration information of a portion of a multimedia content file that is being received, generating index information for each storage capacity unit based on the extracted information, and reproducing the multimedia content using the generated index information, And the like.
On the other hand, a computer readable recording medium characterized by recording a program for executing the above-mentioned multimedia content reproducing method.
The recording medium according to the present invention is a server which is a wired or wireless terminal on which the program is executed, or stores and manages the program and transmits the program to a user terminal.
Meanwhile, the multimedia contents reproduction system according to the present invention repeatedly checks the storage capacity information of the multimedia contents being received, generates index information for each storage capacity unit based on the storage capacity information, A program for reproducing the multimedia contents using index information, and a server for providing the multimedia contents and the multimedia contents reproduction program to a user terminal or a wireless terminal.
Meanwhile, the method of reproducing multimedia contents according to the present invention includes the steps of: repeatedly checking storage capacity information of multimedia contents being received when reproducing streaming multimedia contents; Generating index information on the multimedia contents being received for each unit capacity when the determined storage capacity information matches the index generation unit capacity information as a result of the determination; And reproducing the multimedia contents in a streaming manner using the index information.
In the method of reproducing multimedia contents according to the present invention, it is preferable to check the communication performance (bytes / sec) and set the index generation unit capacity information for reproducing the streaming multimedia contents on the basis of the confirmed communication performance information And further comprising:
On the other hand, a computer-readable recording medium on which a program for executing the above-described multimedia content reproducing method is recorded.
Meanwhile, the multimedia contents reproduction system according to the present invention repeatedly checks the storage capacity information of the multimedia contents being received when reproducing the multimedia contents of the streaming system, and determines whether the stored storage capacity information matches the index generation unit capacity information And generating index information for the multimedia contents being received for each unit capacity and then generating index information generated for each unit capacity when the determined storage capacity information matches the index generation unit capacity information as a result of the determination, A server for providing the multimedia contents reproduction program to a user terminal or a wireless terminal and transmitting the multimedia contents to the user terminal or the wireless terminal in a streaming manner; .
According to another aspect of the present invention, there is provided a method for reproducing multimedia contents, comprising the steps of: storing and storing index generation unit capacity information for each communication performance (bytes / sec) of a terminal that reproduces multimedia contents in a streaming manner; A step of repeatedly checking storage capacity information of multimedia contents being received and determining whether the stored storage capacity information corresponds to the stored index generation unit capacity information; Generating index information for the multimedia contents being received according to the unit capacity if the capacity information matches the index generation unit capacity information, and reproducing the multimedia contents in a streaming manner using the index information generated for each unit capacity to the formed include .
Meanwhile, the multimedia contents reproducing system according to the present invention repeatedly checks the storage capacity information of the multimedia contents being received when reproducing the multimedia contents in the streaming mode, and if the confirmed storage capacity information is stored in the stored communication performance (bytes / sec ) - judges whether or not the communication capacity (bytes / sec) of the terminal that reproduces the multimedia contents in the streaming manner meets the index generation unit capacity information of each of them, and if the confirmed storage capacity information indicates the communication performance (bytes / sec) index information of the received multimedia contents is generated for each unit capacity, and then the multimedia contents are reproduced in a streaming manner using the index information generated for each unit capacity Program and the multimedia content reproduction program to the user Providing a line terminal or wireless terminal, and the multimedia content, characterized in that comprises a server for transmitting to the user wired terminal and a wireless terminal in a streaming manner.
Meanwhile, the multimedia contents reproducing apparatus according to the present invention repeatedly checks the storage capacity information of the received multimedia contents when reproducing the predetermined multimedia contents, and based on the determined storage capacity information, An information generation unit for extracting configuration information of a portion of a multimedia content file being received, generating index information for each storage capacity unit based on the extracted information, and a content reproduction unit for reproducing the multimedia content using the generated index information, And the like.
Meanwhile, the multimedia contents reproducing apparatus according to the present invention repeatedly checks the storage capacity information of the multimedia contents being received when reproducing the multimedia contents in the streaming mode, and determines whether the stored storage capacity information matches the index generation unit capacity information An information generating unit for generating index information for the multimedia contents being received for each unit capacity when the determined storage capacity information matches the index generation unit capacity information as a result of the determination, And a content reproducing unit for reproducing the multimedia contents using the information.
Meanwhile, the multimedia contents reproducing apparatus according to the present invention includes an information setting unit for preliminarily storing index generating unit capacity information for each communication performance (bytes / sec) of a terminal that reproduces multimedia contents in a streaming manner, An information checking unit for repeatedly checking storage capacity information of multimedia contents being received and determining whether the stored storage capacity information matches the stored index generation unit capacity information at the time of playback; An information generation unit for generating index information for the multimedia contents being received in units of capacity when the storage capacity information matches the index generation unit capacity information and a content playback unit for playing the multimedia content using the generated index information . do.
Meanwhile, the multimedia contents reproducing apparatus according to the present invention includes at least one device for reproducing the multimedia contents in a streaming manner via a wired communication network, and an apparatus for reproducing the multimedia contents in a streaming manner through a wireless communication network .
On the other hand, a computer-readable recording medium on which a program for executing the functions of the above-mentioned apparatus constitution unit of the multimedia content reproducing apparatus is recorded.
According to another aspect of the present invention, there is provided a method of reproducing multimedia content, the method comprising: checking capacity information of received multimedia contents; and, if the determined capacity information matches a preset unit capacity, And a computer-readable recording medium storing a program for executing the program.
According to the present invention, in receiving multimedia contents including a file structure that can not be played back in real time, it is possible to periodically check the reception capacity information per unit time of the received multimedia contents, (For example, index update is possible without interruption of reproduction) based on the index update criterion capacity information, and generates and applies index information for the multimedia content at the time when the index update criterion capacity is received, There is an advantage that the multimedia contents including the file structure in which real-time reproduction is impossible can be reproduced in real time without interruption.
According to the present invention, in receiving multimedia contents including a file structure that can not be played back in real time, it is possible to periodically check the reception capacity information per unit time of the received multimedia contents, (E.g., index update reference capacity information capable of updating the index without interrupting playback), and if the multimedia content reception rate is below the multimedia content reproduction rate for a predetermined time, the multimedia content is played back seamlessly There is an advantage of eliminating the complaints and questions of the spectators viewing the multimedia contents.
FIG. 2 is a diagram illustrating a configuration of a real-time playback program function recorded on a recording medium provided in a terminal device for real-time playback of multimedia contents according to a first embodiment of the present invention.
3 is a view showing a real-time reproduction of multimedia contents according to a first embodiment of the present invention.
4 is a diagram showing a configuration of a real-time playback program function recorded on a recording medium provided in a terminal device for real-time playback of multimedia contents according to the embodiment of the present invention.
FIG. 5 is a view showing a real-time playback of multimedia contents according to the embodiment of the present invention.
6 is a diagram illustrating a real-time playback program function configuration recorded on a recording medium provided in a terminal device for real-time playback of multimedia contents according to a third embodiment of the present invention.
7 is a view showing a real-time playback of multimedia contents according to a third embodiment of the present invention.
FIG. 8 is a diagram illustrating a configuration of a real-time playback program function recorded on a recording medium provided in a terminal device for real-time playback of multimedia contents according to a fourth embodiment of the present invention.
9 is a view showing a real-time playback of multimedia contents according to a fourth embodiment of the present invention.
The operation principle of the preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings and description. It should be understood, however, that the drawings and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention, and are not to be construed as limiting the present invention. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The terms used below are defined in consideration of the functions of the present invention, which may vary depending on the user, intention or custom of the operator. Therefore, the definition should be based on the contents throughout the present invention.
It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. The configuration is omitted as much as possible, and a functional configuration that should be additionally provided for the present invention is mainly described. Those skilled in the art will readily understand the functions of components that have been used in the prior art among the functional configurations that are not shown in the following description, The relationship between the elements and the components added for the present invention will also be clearly understood.
In order to efficiently explain the essential technical features of the present invention, the following embodiments will appropriately modify, integrate, or separate terms to be understood by those skilled in the art to which the present invention belongs , And the present invention is by no means thereby limited.
2 is a diagram illustrating a real-time playback program function configuration recorded on a recording medium provided in a terminal device for real-time playback of multimedia contents according to a first embodiment of the present invention.
2 is a block diagram showing a configuration of a multimedia content (for example, a file including a file structure capable of streaming playback) that has not been downloaded (or is being received) from a predetermined content providing server 230 (or a messenger terminal 235) (E.g., a desktop computer, a notebook computer, a mobile communication terminal, a portable Internet terminal, a wireless LAN terminal, a bidirectional digital TV, an IPTV, or the like) in order to reproduce the multimedia contents In a case where the real-time reproduction program has predetermined index generation unit capacity information for real-time reproduction of the multimedia contents (or reproduction in a streaming manner), the real- Based on the index generation unit capacity information, Degas the (or receiving) the multimedia contents is not completed illustrates the exemplary method for real-time playback (or played in a streaming method).
Those skilled in the art will be able to refer to and modify various aspects of the real-time playback program functionality for real-time playback of multimedia content, The invention encompasses all of the above-mentioned contemplated embodiments and is not limited to the embodiment shown in FIG.
For example, in FIG. 2, a function configuration unit (a content receiving unit 275) for downloading predetermined multimedia contents that have not been downloaded from a predetermined content providing server 230 (or a messenger terminal 235) ) Is included in the real-time playback program. However, the present invention is not limited thereto, and the function of downloading the multimedia content may be realized by using an application program other than the real-time playback program (for example, A browser program, a messenger program, or the like), and thus the present invention is not limited thereto.
Referring to FIG. 2 according to an embodiment of the present invention, the terminal device may be a wired communication network based on a TCP / IP (Transmission Control Protocol / Internet Protocol) or a High Speed Downlink Packet Access (HSDPA) And a communication processing unit 220 for connecting a communication channel with a predetermined server (or terminal) through a communication network, an IEEE 802.16x based wireless communication network, or the like.
The communication processing unit 220 is connected to the terminal device through a predetermined communication network (e.g., TCP / IP based wired communication network, HSDPA (High Speed Downlink Packet Access) based wireless communication network, IEEE 802.16x based wireless communication network, The program providing server 225 stores and manages a real-time reproduction program, and connects the communication channel with a predetermined program providing server 225 that transmits the real-time reproduction program to the terminal device. The real-time reproduction program recorded on the recording medium of the terminal device is downloaded to the recording medium provided in the terminal device.
Also, the communication processing unit 220 may be connected to a predetermined communication network (e.g., TCP / IP based wired communication network, HSDPA (High Speed Downlink Packet Access) based wireless communication network, IEEE 802.16x based wireless communication network, (Or the messenger terminal 235) through a communication channel for downloading (or receiving) multimedia content to a predetermined content providing server 230 (or the messenger terminal 235) through the content providing server 230 (Or receiving) at least one multimedia content stored in a predetermined storage medium provided in the mobile terminal.
Referring to FIG. 2, the terminal including the real-time playback program may include a screen output unit 200 for outputting video data of the multimedia content, a sound processing unit 205 for outputting audio data of the multimedia content, And a key input unit 210 for inputting various keys for controlling the reproduction of the multimedia contents. The predetermined content providing server 230 (or the messenger terminal 235) and the communication for receiving the multimedia contents A communication processing unit 220 for connecting and managing channels and a memory unit 215 for storing the downloaded multimedia contents, wherein the real-time reproduction program is a program for causing a computer to function as: When the download from the providing server 230 (or the messenger terminal 235) is not completed ) Is characterized in that the predetermined multimedia content to be played back is played back in real time.
The screen output unit 200 outputs the video data of the multimedia contents decoded in the real time reproduction program in order to reproduce the multimedia contents downloaded (or received) through the communication processing unit 220 in real time And a screen outputting means for outputting the screen outputting means.
The sound processing unit 205 outputs the audio data of the multimedia contents decoded in the real time reproduction program in order to reproduce the multimedia contents downloaded (or received) through the communication processing unit 220 in real time (or in a streaming manner) And a sound output means for outputting sound.
The memory unit 215 stores the received multimedia contents when predetermined multimedia contents are received from a predetermined content providing server 230 (or the instant messenger terminal 235), and the multimedia contents A header portion 285 including predetermined content header information, a video data portion 290 including predetermined video / audio data, and an index portion 295 including index information necessary for reproducing the multimedia content .
The header part 285 of the multimedia content is structured information that is positioned next to a FOURCC character code (hereinafter referred to as a " RIFF ") of the multimedia content. The header part 285 includes predetermined main header information, stream header information, At least one header information such as information, stream data, stream name, and the like.
The video data unit 290 is preferably composed of a plurality of chunks configured by a predetermined data unit by interleaving predetermined video data and audio data. The video data unit 290 may include video data (e.g., And audio data) are reproduced in the chunk unit.
According to the embodiment of the present invention, the video data unit 290 may directly describe at least one data chunk in the video data unit 290 ('movi'), and may record at least one data chunk in a predetermined record And grouping them into chunks (&quot; rec &quot;).
The index unit 295 may include a chunk identifier for reproducing the image data in units of chunks, flag information, a chunk offset, and a chunk size.
Referring to FIG. 2, the real-time playback program controls the real-time playback program to operate based on a recording medium provided in the terminal device in cooperation with an operating system (or platform) provided in the terminal device, At least one function configuration unit constituting the real time reproduction program for real time reproduction is interlinked, and / or at least one function configuration unit provided in the terminal apparatus through an operating system (or a platform) And a main frame part for performing a function for real time reproduction of the multimedia contents in cooperation with the above-mentioned components.
Wherein the main frame unit includes a program execution code for causing the real time reproduction program to be executed on an operating system (or a platform) provided in the terminal apparatus, The real time reproduction program is executed based on the operating system (or platform) provided in the terminal device in response to the command.
The main frame unit controls the at least one functional unit included in the real-time playback program to interlock with each other for real-time playback of the multimedia content, At least one function configuration unit constituting the program allocates an instance to the mainframe unit so that the function configuration units are cross-referenced and / or interlocked.
In addition, the main frame unit may include at least one or more components (e.g., a key input unit 210 and / or a screen output unit 200) provided in the terminal device for real-time reproduction of the multimedia contents (And / or an interrupt) for accessing the terminal, wherein each of the functional components constituting the real-time reproduction program accesses each component provided in the terminal device, And performs a unique function defined in the function constituent part of the function block.
In addition, the main frame unit may include at least one or more components (e.g., a key input unit 210 and / or a screen output unit 200) provided in the terminal device for real-time reproduction of the multimedia contents And to access an input / output bus corresponding to a peripheral device provided in the terminal device, whereby each of the functional components constituting the real time reproduction program is able to access an input / And accesses each component provided in the apparatus to perform a unique function defined in each functional component.
Referring to FIG. 2, the real-time playback program includes a content receiving unit 230 for receiving predetermined multimedia contents from a predetermined content providing server 230 (or messenger terminal 235) through the communication network in cooperation with the communication processing unit 220, And a content storage unit 280 for storing the received multimedia contents in the memory unit 215. The content storage unit 280 stores the received multimedia contents in the memory unit 215. [
The content receiving unit 275 is configured to receive predetermined multimedia content to be received from a predetermined content providing server 230 (or the messenger terminal 235) provided on the communication network in cooperation with the communication processing unit 220 And the content receiving unit 275 sequentially receives the video data unit 290 and the index unit 295 from the header part 285 of the multimedia content.
The content storage unit 280 stores the multimedia content received from the content providing server 230 (or the instant messenger terminal 235) in association with the communication processing unit 220 in the memory unit The content receiving unit 275 sequentially receives the multimedia content from the header unit 285 to the video data unit 290 and the index unit 295, The control unit 280 sequentially stores the received multimedia contents from the header unit 285 to the video data unit 290 and the index unit 295 in order.
According to an embodiment of the present invention, the content receiver 275 and the content storage unit 280 are included in a predetermined content reproduction unit (e.g., a content reproduction program included in the terminal) .
According to another embodiment of the present invention, the content receiver 275 may be provided in a predetermined browser communication unit (for example, a browser program included in the terminal apparatus, not shown) provided in the terminal apparatus, (For example, a messenger program included in the terminal device, not shown) provided in the terminal device.
Referring to FIG. 2, the real-time playback program includes a content playback unit 245 for confirming (or selecting) multimedia content to be played back among predetermined multimedia content stored (or stored) in the memory unit 215, A real-time reproduction determining unit 260 for determining whether the multimedia contents to be reproduced are a real-time reproduction object, and a real-time reproduction determining unit 260 for determining a storage capacity for repeatedly checking the storage capacity of the received multimedia contents, An information checking unit 265 periodically checking whether the storage capacity of the multimedia contents reaches (or exceeds) predetermined index generation unit capacity information for real-time playback (or streaming playback) Wherein the storage capacity of the multimedia contents reaches the index generation unit capacity (or An information extracting unit 255 for extracting configuration information of a portion of the multimedia content file stored in the memory unit 215 to generate index information for each storage capacity unit, And an information generation unit 250 for generating storage unit index information for the multimedia contents. The content reproduction unit 245 may generate the multimedia content based on the index information for each storage capacity unit, Is reproduced.
The content reproducing unit 245 may identify the multimedia contents to be reproduced among at least one or more multimedia contents stored (or stored) in the memory unit 215 in cooperation with the screen output unit 200 and the key input unit 210 (Or selected), and performs predetermined initialization to reproduce the predetermined multimedia content to be reproduced (or selected). In the initialization operation, the real-time reproduction determination unit 260 determines whether the reproduction Reads the file information of the target multimedia contents and confirms whether the target multimedia content is included in the real-time playback object.
According to one embodiment of the present invention, the real-time reproduction determination unit 260 reads the file handle information (or the interrupt information on the file or the access right information of the file) of the multimedia contents to be reproduced, It is preferable to check whether the multimedia contents to be reproduced are included in the real-time reproduction object by checking whether the object multimedia contents are being received by the contents receiver 275 or the multimedia contents being stored by the contents storage unit 280 Do.
If the multimedia contents to be reproduced are being received by the contents receiving unit 275 or the content receiving unit 275 receives the result of the reading of the file handle information (or the interrupt information on the file or the access right information of the file) Or if the multimedia content is being stored by the content storage unit 280, the multimedia content may be included in the real-time playback object.
According to another embodiment of the present invention, the real-time reproduction determination unit 260 determines whether or not an index unit 295 valid for the multimedia contents file is based on the header information included in the header portion 285 of the multimedia contents to be reproduced It is preferable to check whether the multimedia contents to be reproduced are included in the real-time reproduction object.
If the effective index unit 295 is not included in the multimedia contents to be played back, the multimedia contents are preferably included in the real time playback object.
If it is determined that the multimedia content to be reproduced is not included in the real-time playback object, the content playback unit 245 may perform the multimedia content playback procedure according to the predetermined multimedia content playback procedure The content reproduction unit 245 may include a multimedia content (for example, a streaming playback enabled file structure) that is not included in the real-time playback target The multimedia content that has been downloaded, or the multimedia content that has been downloaded). Therefore, detailed description thereof will be omitted for the sake of convenience.
If it is determined that the multimedia contents to be reproduced are included in the real time reproduction object, the real time reproduction determination unit 260 transmits the multimedia contents information to the storage capacity determination unit 265, .
The storage capacity checking unit 265 periodically checks the storage capacity of the multimedia content received through the content receiver 275 or stores the multimedia content in the memory unit 215 through the content storage unit 280 And the multimedia contents storage capacity is checked periodically.
The information verifying unit 270 checks whether the multimedia content storage capacity reaches (or exceeds) a predetermined index generation unit capacity.
According to an embodiment of the present invention, the information verifying unit 270 may include a predetermined index for generating predetermined index information required for real-time reproduction (or streaming) of predetermined multimedia contents in the real- And includes generation unit capacity information (e.g., included in the program code in a constant form).
According to another embodiment of the present invention, the predetermined index generation unit capacity information for generating predetermined index information required for real-time playback (or streaming playback) of predetermined multimedia contents in the real- And the information verifying unit 270 may check the index generation unit capacity information stored in the memory unit 215. The memory unit 215 stores the index generation unit capacity information.
According to the embodiment of the present invention, when the storage capacity of the identified multimedia contents reaches (or exceeds) the index generation unit capacity, the information verification unit 270 generates index information for storage capacity unit for the multimedia contents It is preferable to confirm that the condition is satisfied.
If it is determined by the information verification unit 270 that the index information generation condition for each storage capacity unit is satisfied, the information extraction unit 255 extracts the index information for each unit of capacity And extracts configuration information of a portion of the multimedia content file stored in the storage unit (215).
According to an embodiment of the present invention, the information extracting unit 255 extracts header information for the multimedia contents by reading the header part 285 of the multimedia contents, and extracts header information of the multimedia contents based on the header information, It is preferable to extract data chunk information including at least one format, position and size of at least one data chunk included in the image data portion 290 based on the character code and the size of the data chunk.
For example, the information extracting unit 255 may check the size of the first data chunk including the second character code (e.g., 00db, 00dc, 00pc, or 00wb) of the first data chunk and the actual stream data, (E.g., 01db, or 01dc, or 01pc, or 01wb) after the first data chunk, wherein the second character chunk of the second data chunk identifies the actual stream data of the first data chunk It will be located next.
If the information extracting unit 255 determines the first character code and size and actual stream data of the nth (n > 1) data chunk and then stores the (n + 1) If the chunk character code of the chunk is not confirmed, if the n-th data chunk is regarded as damaged, the information extracting unit 255 shifts the actual stream data of the n-th data chunk by one byte It is preferable to check the first character code and size and actual stream data of the (n + 1) -th data chunk after retrieving the second character code of the (n + 1) -th data chunk, .
When the data chunk information including at least one of a format, a position, and a size of at least one data chunk included in the image data unit 290 is extracted, the information generation unit 250 generates the data chunk information Index information for each storage capacity unit for reproducing the multimedia contents is generated based on the storage capacity unit index information, and the index information for each storage capacity unit is generated in the form of an AVIINDEXENTRY structure.
The content reproduction unit 245 reproduces the multimedia contents to be reproduced based on the storage unit index information generated by the information generation unit 250.
The storage capacity verifying unit 265 repeatedly checks the storage capacity of the received multimedia content in association with the content receiving unit 275 (or the content storage unit 280) The information verifying unit 270 checks whether the storage capacity of the multimedia content reaches (or exceeds) predetermined index generation unit capacity information for real-time reproduction (or reproduction in a streaming manner), and the information extracting unit 255 Extracting configuration information of a portion of the multimedia content file stored in the memory unit 215 and generating the index information for each storage capacity unit for the multimedia content based on the extracted configuration information The multimedia contents are all received through the contents receiving unit 275, and the multimedia contents received through the contents storing unit 280 That both control content is being repeated until the storage in the memory unit 215 is preferred.
When the multimedia contents are all received / stored through the contents receiver 275 and the contents storage 280, the information generator 250 generates final index information on the multimedia contents. The content reproduction unit 245 reproduces the multimedia content based on the final index information.
FIG. 3 is a view showing a real-time reproduction of multimedia contents according to a first embodiment of the present invention.
FIG. 3 illustrates a real-time playback program provided in the terminal device shown in FIG. 2 when the multimedia content including the content structure shown in FIG. 1 is played back, (Or reproducing in a streaming manner) of the multimedia contents by referring to and / or modifying the FIG. 3 if a person skilled in the art is familiar with the present invention. It is to be understood that the invention may be practiced otherwise than as specifically described herein. The invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth in the accompanying drawings.
Hereinafter, the terminal device shown in FIG. 2 having the real-time playback program in FIG. 3 is referred to as a "terminal" for the sake of convenience.
Referring to FIG. 3, it is assumed that multimedia content to be played back by the terminal is provided to the terminal from among at least one multimedia content provided in a predetermined content providing server 230 (or messenger terminal 235) (300) and executes the real-time playback program shown in FIG. 2 to receive the multimedia content to be played back provided by the content providing server 230 (or the instant messenger terminal 235) (305) If more than the header portion 285 of the target multimedia content is received (310), the header information of the multimedia content to be played back is read to check whether the multimedia content to be played back is included in the real time playback object (315).
According to an embodiment of the present invention, the terminal reads the file handle information (or the interrupt information on the file or the access right information of the file) of the multimedia contents to be played back, It is preferable to check whether the multimedia contents to be reproduced are included in the real time reproduction target by checking whether the multimedia contents are being received by the receiving unit 275 or being stored by the content storage unit 280. [
According to another embodiment of the present invention, the terminal determines whether a valid index unit 295 is included in the multimedia content file based on the header information included in the header part 285 of the playback target multimedia content , It is preferable to check whether the multimedia contents to be reproduced are included in the real-time reproduction object.
If the multimedia content to be reproduced is not included in the real-time playback object (320), the terminal plays the multimedia content to be played according to a predetermined multimedia content playback procedure (325).
Those skilled in the art will appreciate that the terminal may be capable of providing multimedia content (eg, multimedia content including a file structure capable of streaming playback, or downloaded multimedia content) that is not included in the real- The detailed description thereof will be omitted for the sake of convenience.
If the multimedia content to be played back is included in the real-time playback object 320, the terminal determines that the multimedia content storage capacity to be played received from the content providing server 230 (or the instant messenger terminal 235) (Or exceeding) the unit capacity by checking whether the first (i = 1) index information generation condition for each unit capacity is satisfied (330).
If it is confirmed that the index information generation condition for the first (i = 1) unit capacity is satisfied (335), the terminal extracts header information and data chunk information for the multimedia content to be reproduced (340).
According to an embodiment of the present invention, the terminal reads header information of the multimedia content by reading the header part 285 of the multimedia content, extracts header information of the multimedia content from the header character code of the data chunk, Position, and size of at least one data chunk included in the image data unit 290 based on the size of the data chunk.
For example, the terminal checks the size of the first data chunk and the actual stream data including the second character code (e.g., 00db, 00dc, 00pc, or 00wb) of the first data chunk, (E.g., 01db, or 01dc, or 01pc, or 01wb) of the first data chunk, the second chunk character code of the second data chunk will be located after the actual stream data of the first data chunk .
If the terminal checks the first character code and the size and actual stream data of the nth (n > 1) data chunk and then inserts the second character code of the (n + 1) th data chunk after the actual stream data of the nth data chunk (N + 1) -th data chunk is shifted in units of one byte while the n-th data chunk is considered to be corrupted, After retrieving the character code, it is desirable to identify the coded character code and size of the (n + 1) -th data chunk and the actual stream data, thereby detecting corrupted data chunks.
Then, the terminal generates (i = 1) unit-by-unit index information for reproducing the received multimedia contents based on the extracted header information and data chunk information (345), and the generated first the first (i = 1) multimedia content reproduction area is decoded and reproduced (350) based on the index information (i = 1) per unit capacity, and it is determined whether all the multimedia contents being reproduced are received (step 355).
If the multimedia contents are not all received (360), the terminal determines that the multimedia contents storage capacity to be received received from the contents providing server 230 (or the instant messenger terminal 235) reaches the preset index generation unit capacity (I + 1) -th capacity index information generation condition is satisfied (step 365), and the index information for each unit capacity is generated according to the result of the check, The process of reproducing the content is repeated.
If all of the multimedia contents are received (360), the terminal generates final index information for the multimedia contents to be played 370, decodes the multimedia contents through the generated final index information, (375).
FIG. 4 is a diagram illustrating a configuration of a real-time playback program function recorded on a recording medium provided in a terminal device for real-time playback of multimedia contents according to the embodiment of the present invention.
4 is a block diagram showing a configuration of a content providing server 430 (or a messenger terminal 435) which receives predetermined multimedia contents (for example, a streaming playback enabled file structure (E.g., a desktop computer, a notebook computer, a mobile communication terminal, a portable Internet terminal, a wireless LAN terminal, a bidirectional digital TV, an IPTV, or the like) in order to reproduce the multimedia contents The present invention relates to a preferred functional configuration of a real-time reproduction program, in which a predetermined index generation unit capacity information corresponding to a communication performance for downloading (or receiving) the multimedia contents is set in the real-time reproduction program as a volume, Based on the capacity information, if the download is not completed Being) shows an exemplary method for periodically generating a unit dose by the index information for a multimedia content, playing back the multimedia content in real-time reproduction (or streaming).
Those skilled in the art will be able to conceive of various implementations of the real-time playback program functionality for real-time playback of multimedia content by referring to and / or modifying FIG. 4, The invention encompasses all of the above-mentioned contemplated embodiments and is not limited to the embodiment shown in FIG.
4, a function configuration unit (a content reception unit 480, a content storage unit 485, and a content storage unit 485) for downloading predetermined multimedia contents that have not been downloaded from a predetermined content provision server 430 (or the IM terminal 435) ) Is included in the real-time playback program. However, the present invention is not limited thereto, and the function of downloading the multimedia content may be realized by using an application program other than the real-time playback program (for example, A browser program, a messenger program, or the like), and thus the present invention is not limited thereto.
4 according to an embodiment of the present invention, the terminal device may be a wired communication network based on a TCP / IP (Transmission Control Protocol / Internet Protocol) or a High-Speed Downlink Packet Access (HSDPA) And a communication processing unit 420 for connecting a communication channel with a predetermined server (or terminal) through a communication network, an IEEE 802.16x based wireless communication network, or the like.
The communication processing unit 420 is connected to the terminal device through a predetermined communication network (for example, a TCP / IP based wired communication network, HSDPA (High Speed Downlink Packet Access) based wireless communication network, IEEE 802.16x based wireless communication network, The program providing server 425 stores and manages a real-time reproduction program, and connects the communication channel with a predetermined program providing server 425 that transmits the real-time reproduction program to the terminal device. The real-time reproduction program recorded on the recording medium of the terminal device is downloaded to the recording medium provided in the terminal device.
Also, the communication processing unit 420 may be connected to a predetermined communication network (e.g., a TCP / IP based wired communication network, a HSDPA (High Speed Downlink Packet Access) based wireless communication network, an IEEE 802.16x based wireless communication network, (Or the messenger terminal 435) through a communication channel for downloading (or receiving) multimedia content to a predetermined content providing server 430 (or the IM terminal 435) through the content providing server 430 (Or receiving) at least one multimedia content stored in a predetermined storage medium provided in the mobile terminal.
4, the terminal equipped with the real-time playback program may include a screen output unit 400 for outputting the video data of the multimedia content, a sound processing unit 405 for outputting the audio data of the multimedia content, And a key input unit 410 for inputting various keys for controlling the reproduction of the multimedia contents. The predetermined content providing server 430 (or the IM terminal 435) and the communication for receiving the multimedia contents And a memory unit 415 for storing the downloaded multimedia contents, wherein the real-time playback program is a program for causing a computer to function as: If the download from the providing server 430 (or messenger terminal 435) is not completed ) Is characterized in that the predetermined multimedia content to be played back is played back in real time.
The screen output unit 400 outputs the video data of the multimedia contents decoded in the real time reproduction program in order to reproduce the multimedia contents downloaded (or received) through the communication processing unit 420 in real time And a screen outputting means for outputting the screen outputting means.
The sound processing unit 405 outputs the audio data of the multimedia content decoded in the real time reproduction program in order to reproduce the multimedia contents downloaded (or received) through the communication processing unit 420 in real time And a sound output means for outputting sound.
The memory unit 415 stores the received multimedia content when predetermined multimedia content is received from a predetermined content providing server 430 (or the messenger terminal 435) A header part 490 including predetermined content header information, a video data part 495 including predetermined video / audio data, and an index part 497 including index information necessary for reproducing the multimedia content .
The header portion 490 of the multimedia content is structured information that is positioned next to a FOURCC character code (FOURCC) called "RIFF" of the multimedia content. The header portion 490 includes predetermined main header information, stream header information, At least one header information such as information, stream data, stream name, and the like.
The image data unit 495 may be composed of a plurality of chunks configured by a predetermined data unit by interleaving predetermined video data and audio data. The image data unit 495 may include image data (e.g., And audio data) are reproduced in the chunk unit.
According to an embodiment of the present invention, the image data unit 495 may include at least one data chunk directly described in the image data unit 495 ('movi') and at least one data chunk with a predetermined record And grouping them into chunks (&quot; rec &quot;).
The index unit 497 preferably includes a chunk identifier for reproducing the image data in units of chunks, flag information, a chunk offset, and a chunk size.
Referring to FIG. 4, the real-time playback program controls the real-time playback program to operate based on a recording medium provided in the terminal in cooperation with an operating system (or platform) provided in the terminal, At least one function configuration unit constituting the real time reproduction program for real time reproduction is interlinked, and / or at least one function configuration unit provided in the terminal apparatus through an operating system (or a platform) And a main frame unit 440 (Mainframe) for performing a function for real-time playback of the multimedia contents in cooperation with the above-described components.
The main frame unit 440 is characterized in that the real time reproduction program includes a program execution code to be executed on an operating system (or a platform) provided in the terminal apparatus, The real time reproduction program is executed based on the operating system (or platform) provided in the terminal device in response to a predetermined program execution command.
In addition, the main frame unit 440 controls the at least one functional unit included in the real-time playback program to interoperate with each other for real-time playback of the multimedia content. At least one functional component configuring the real-time reproduction program allocates an instance to the main frame unit 440 so that the functional components are cross-referenced and / or interlocked.
The main frame unit 440 may include at least one or more components (for example, a key input unit 410 and / or a screen output unit 400) provided in the terminal device for real- (Or an interrupt) for accessing the terminal device (e.g., a terminal, a terminal, etc.) of the terminal device, And performs a unique function defined in each functional component.
The main frame unit 440 may include at least one or more components (for example, a key input unit 410 and / or a screen output unit 400) provided in the terminal device for real- Or the like), and / or to access an input / output bus corresponding to a peripheral device provided in the terminal device, thereby making it possible to configure each function constituting the real time reproduction program And the units access the respective components provided in the terminal device and perform unique functions defined in the respective functional components.
Referring to FIG. 4, the real-time playback program includes a content receiving unit 430 for receiving predetermined multimedia content from a predetermined content providing server 430 (or the messenger terminal 435) through the communication network in cooperation with the communication processing unit 420, And a content storage unit 485 for storing the received multimedia contents in the memory unit 415.
The content receiving unit 480 receives predetermined multimedia content to be received from a predetermined content providing server 430 (or the messenger terminal 435) provided on the communication network in cooperation with the communication processing unit 420 And the content receiving unit 480 sequentially receives the video data unit 495 and the index unit 497 from the header part 490 of the multimedia content.
The content storage unit 485 stores the multimedia content received from the content providing server 430 (or the messenger terminal 435) in association with the communication processing unit 420 in the memory unit When the content receiving unit 480 sequentially receives the multimedia content from the header unit 490 to the video data unit 495 and the index unit 497, The controller 485 also sequentially stores the received multimedia contents from the header 490 to the video data unit 495 and the index unit 497. FIG.
According to an embodiment of the present invention, the content receiver 480 and the content storage unit 485 are included in a predetermined content reproduction unit (for example, a content reproduction program included in the terminal) .
According to another embodiment of the present invention, the content receiver 480 may be provided in a predetermined browser communication unit (for example, a browser program included in the terminal apparatus, not shown) provided in the terminal apparatus, (For example, a messenger program included in the terminal device, not shown) provided in the terminal device.
4, the real-time playback program includes a content playback unit 450 for confirming (or selecting) multimedia content to be played back among predetermined multimedia content stored (or stored) in the memory unit 415, (Or a content receiving unit 480) when the multimedia contents to be reproduced are judged to be a real time reproduction target, a real-time reproduction determination unit 445 for checking whether the multimedia contents to be reproduced are real- An information setting unit 465 for setting predetermined index generation unit capacity information capable of seamlessly downloading (or receiving) the multimedia contents to be reproduced; and a storage unit 465 for repeatedly checking the storage capacity of the received multimedia contents An identification unit 470 for storing the multimedia content, (Or exceeding) the storage capacity of the multimedia contents, and if the storage capacity of the multimedia contents reaches (or exceeds) the index generation unit capacity, An information extraction unit 460 for extracting configuration information of a portion of a multimedia content file stored in the memory unit 415, and an information generation unit 460 for generating index information for each unit capacity of the multimedia content based on the extracted configuration information. And the content reproduction unit 450 reproduces the multimedia content based on the index information for each unit capacity.
The content reproducing unit 450 may check the multimedia contents to be reproduced among at least one or more multimedia contents stored (or stored) in the memory unit 415 in cooperation with the screen output unit 400 and the key input unit 410 (Or selects) the predetermined multimedia content, and performs predetermined initialization to reproduce the predetermined multimedia content to be reproduced (or selected). In the initialization operation, the real- Reads the file information of the target multimedia contents and confirms whether the target multimedia content is included in the real-time playback object.
According to an embodiment of the present invention, the real-time playback determination unit 445 reads the file handle information (or the interrupt information on the file or the access right information of the file) of the multimedia contents to be played back, It is preferable to check whether the multimedia content to be played back is included in the real-time playback target by checking whether the target multimedia content is being received by the content receiving unit 480 or the multimedia content being stored by the content storage unit 485 Do.
If the multimedia contents to be reproduced are being received by the contents receiver 480 or the multimedia contents are received by the content receiving unit 480 as a result of reading the file handle information (or the interrupt information on the file or the access right information of the file) Or if the multimedia content is being stored by the content storage unit 485, the multimedia content may be included in a real-time playback object.
According to another embodiment of the present invention, the real-time reproduction determination unit 445 determines whether a valid index unit 497 is included in the multimedia contents file based on the header information included in the header portion 490 of the reproduction- It is preferable to check whether the multimedia contents to be reproduced are included in the real-time reproduction object.
If the index part 497 is not included in the multimedia content to be played back, the multimedia content is preferably included in the real-time playback object.
If it is determined that the multimedia content to be reproduced is not included in the real-time playback object, the content playback unit 450 may repeat the multimedia content playback according to the predetermined multimedia content playback procedure If the content reproducing unit 450 has multimedia contents (for example, a file structure capable of streaming playback) that is not included in the real time reproduction target The multimedia content that has been downloaded, or the multimedia content that has been downloaded). Therefore, detailed description thereof will be omitted for the sake of convenience.
On the other hand, if it is determined that the multimedia content to be reproduced is included in the real-time playback object, the real-time playback determination unit 445 determines that the multimedia content information is to be played back, And provides it to the storage capacity checking unit 470.
The information setting unit 465 checks the communication performance (Bytes / sec) corresponding to the downloading (or receiving) of the multimedia contents in cooperation with the communication processing unit 420 (or the content receiving unit 480) And the predetermined index generation unit capacity information corresponding to the communication performance is set and stored.
According to an embodiment of the present invention, the information setting unit 465 includes at least one communication performance information and index generating unit capacity information corresponding to each communication performance in association with each other (e.g., in a form of a constant in the program code) When the communication performance corresponding to the download (or reception) of the multimedia contents is confirmed, the information setting unit 465 stores the index generation unit capacity information corresponding to the confirmed communication performance in the unit capacity index It is preferable to set the index generation unit capacity information for information generation.
According to another embodiment of the present invention, it is preferable that at least one communication performance information and index generating unit capacity information corresponding to each communication performance are stored in the memory unit 415 in association with each other. Reception), the information setting unit 465 associates the index generation unit capacity information corresponding to the confirmed communication performance with the memory unit 415 to generate the index information for each unit capacity It is preferable that the index generation unit capacity information is set to the index generation unit capacity information.
The storage capacity checking unit 470 periodically checks the storage capacity of the multimedia contents received through the content receiver 480 or stores the multimedia contents in the memory unit 415 through the content storage unit 485 And the multimedia contents storage capacity is checked periodically.
The information checking unit 475 periodically checks whether the checked multimedia content storage capacity reaches (or exceeds) the identified index generation unit capacity.
According to an embodiment of the present invention, when the storage capacity of the identified multimedia contents reaches (or exceeds) the index generation unit capacity, the information confirmation unit 475 generates an index information generation condition Is satisfied.
When it is confirmed by the information verification unit 475 that the index information generation condition for each unit capacity is satisfied for the multimedia contents, the information extraction unit 460 extracts the index information for each unit capacity, And extracts the configuration information of a portion of the multimedia content file stored in the storage unit 415.
According to the embodiment of the present invention, the information extracting unit 460 extracts header information for the multimedia contents by reading the header part 490 of the multimedia contents, and extracts header information of the multimedia contents based on the header information, It is preferable to extract data chunk information including at least one format, position and size of at least one data chunk included in the image data unit 495 based on the character code and the size of the data chunk.
For example, the information extracting unit 460 may check the size of the first data chunk including the first character code (e.g., 00db, 00dc, 00pc, or 00wb) of the first data chunk and the actual stream data, (E.g., 01db, or 01dc, or 01pc, or 01wb) after the first data chunk, wherein the second character chunk of the second data chunk identifies the actual stream data of the first data chunk It will be located next.
If the information extracting unit 460 checks the second character code and the size and actual stream data of the nth (n > 1) data chunk and then stores the (n + 1) If the chunk character code of the chunk is not confirmed, if the n-th data chunk is regarded as damaged, the information extracting unit 460 shifts the actual stream data of the n-th data chunk by one byte It is preferable to check the first character code and size and actual stream data of the (n + 1) -th data chunk after retrieving the second character code of the (n + 1) -th data chunk, .
When the data chunk information including at least one of the format, position, and size of at least one data chunk included in the image data unit 495 is extracted, the information generation unit 455 generates the data chunk information Unit index information for unit capacity to reproduce the multimedia contents is generated on the basis of the unit capacity index information, wherein the unit capacity index information is generated in the form of an AVI index structure.
Hereinafter, the content reproducing unit 450 reproduces the multimedia contents to be reproduced on the basis of the unit capacity index information generated by the information generating unit 455.
According to the embodiment of the present invention, after the information setting unit 465 sets predetermined index generation unit capacity information corresponding to the communication performance, the storage capacity checking unit 470 determines whether the storage capacity of the content receiving unit 480 ( Or the content storage unit 485), the information checking unit 475 repeatedly checks the storage capacity of the received multimedia content, and if the storage capacity of the multimedia content reaches the set index generation unit capacity information The information extracting unit 460 extracts the configuration information of a portion of the multimedia content file stored in the memory unit 415 and the information generating unit 455 extracts the configuration information of the multimedia content file based on the extracted configuration information The process of generating the index information for each unit capacity of the multimedia contents may include receiving the multimedia contents through the content receiver 480 That the multimedia contents received from the content storage unit (485) is repeated until all stored in the memory unit 415 is preferred.
If the multimedia contents are all received / stored through the content receiving unit 480 and the content storing unit 485, the information generating unit 455 generates final index information on the multimedia contents. The content reproduction unit 450 reproduces the multimedia content based on the final index information.
5 illustrates a real-time playback program provided in the terminal device shown in FIG. 4 when the multimedia content including the content structure shown in FIG. 1 is played back, (Or reproducing in a streaming manner) of the multimedia contents by referring to and / or modifying the FIG. 5 if the person skilled in the art is familiar with the present invention However, the present invention includes all of the above-described embodiments, and the technical features of the present invention are not limited only by the method shown in FIG.
Hereinafter, in FIG. 5, the terminal device shown in FIG. 4 having the real-time playback program is referred to as a "terminal" for the sake of convenience.
Referring to FIG. 5, among the at least one multimedia contents provided to a predetermined content providing server 430 (or the messenger terminal 435), the terminal selects predetermined multimedia contents to be played back by the terminal (500) and executes the real-time playback program shown in FIG. 4 to receive the multimedia content to be played back provided by the content providing server 430 (or the IM terminal 435) (505) If more than the header portion 490 of the multimedia content is received (510), the header information of the multimedia content to be reproduced is read to check whether the multimedia content to be reproduced is included in the real-time playback object (515).
According to an embodiment of the present invention, the terminal reads the file handle information (or the interrupt information on the file or the access right information of the file) of the multimedia contents to be played back, It is preferable to check whether the multimedia contents to be reproduced are included in the real time reproduction target by checking whether the multimedia contents are being received by the receiving unit 480 or being stored by the content storage unit 485. [
According to another embodiment of the present invention, the terminal determines whether a valid index unit 497 is included in the multimedia content file based on the header information included in the header part 490 of the multimedia content to be played back , It is preferable to check whether the multimedia contents to be reproduced are included in the real-time reproduction object.
If the multimedia content to be reproduced is not included in the real-time playback object (520), the terminal plays the multimedia content to be played according to a predetermined multimedia content playback procedure (525).
Meanwhile, if the multimedia contents to be reproduced are included in the real-time playback object (520), the terminal checks the communication performance information for the multimedia contents being received (530).
If the communication capability information is confirmed (535), the terminal generates a predetermined index generation unit capacity for reproducing the multimedia contents based on the communication performance information of the multimedia contents to be reproduced (or by streaming) Information is set (540).
Thereafter, the terminal confirms whether the playback target multimedia content storage capacity received from the content providing server 430 (or the IM terminal 435) reaches (or exceeds) the set index generation unit capacity, (i = 1) unit capacity-specific index information generation condition (550).
If it is determined that the index information generation condition for the first (i = 1) unit capacity is satisfied (step 555), the terminal extracts header information and data chunk information for the multimedia content to be reproduced (step 560).
According to an embodiment of the present invention, the terminal reads header information of the multimedia content by reading the header part 490 of the multimedia content, extracts header character information of the data chunk, Location and size of at least one or more data chunks included in the image data unit 495 based on the size of the data chunks.
Then, the terminal generates (i = 1) unit-by-unit index information for reproducing the received multimedia contents based on the extracted header information and data chunk information (565), and the generated first the first (i = 1) multimedia content reproduction area is decoded and reproduced (step 570) based on the index information (i = 1) by unit capacity, and it is determined whether all the multimedia contents being reproduced have been received (step 575).
If all of the multimedia contents are not received (580), the terminal determines whether the multimedia contents storage capacity to be received received from the contents providing server 430 (or the messenger terminal 435) reaches the set index generation unit capacity (I + 1) unit capacity index generation condition is satisfied (585), and the index information for each unit capacity is generated according to the check result, The process of reproducing the content is repeated.
If all the multimedia contents are received (580), the terminal generates final index information on the multimedia contents to be played back (590), decodes the multimedia contents through the generated final index information, (595).
FIG. 6 is a diagram illustrating a real-time playback program function configuration recorded on a recording medium provided in a terminal device for real-time playback of multimedia contents according to a third embodiment of the present invention.
6 shows an example of a predetermined multimedia content (for example, a file including a file structure capable of streaming playback) that has not been downloaded (or is being received) from a predetermined content providing server 630 (or messenger terminal 635) (E.g., a desktop computer, a notebook computer, a mobile communication terminal, a portable Internet terminal, a wireless LAN terminal, a bidirectional digital TV, an IPTV, or the like) in order to reproduce the multimedia contents A real time reproduction program periodically checks predetermined index generation unit capacity information corresponding to a communication performance for downloading (or receiving) the multimedia contents, Based on the predetermined index generation unit capacity information corresponding to the performance It illustrates an exemplary method of the download is not completed (or receiving) (playback or streaming), the multimedia content to periodically generate a unit dose by the index information for a multimedia content, real-time playback.
Those skilled in the art will be able to refer to and modify various aspects of the real-time playback program functionality for real-time playback of multimedia content, The invention encompasses all of the above-described inferred embodiments, and is not limited to the embodiment shown in FIG.
6, a function configuration unit (a content receiving unit 685) for downloading predetermined multimedia contents that have not been downloaded from a predetermined content providing server 630 (or a messenger terminal 635), a content storing unit 690 ) Is included in the real-time playback program. However, the present invention is not limited thereto, and the function of downloading the multimedia content may be realized by using an application program other than the real-time playback program (for example, A browser program, a messenger program, or the like), and thus the present invention is not limited thereto.
6 according to an embodiment of the present invention, the terminal device may be a wired communication network based on a predetermined communication network (e.g., TCP / IP) or a High Speed Downlink Packet Access (HSDPA) And a communication processing unit 620 for connecting a communication channel to a predetermined server (or terminal) through a communication network, an IEEE 802.16x based wireless communication network, or the like.
The communication processing unit 620 is connected to the terminal device through a predetermined communication network (for example, a TCP / IP based wired communication network, HSDPA (High Speed Downlink Packet Access) based wireless communication network, IEEE 802.16x based wireless communication network, (625) that stores and manages a real-time playback program and transmits the real-time playback program to the terminal device. The program providing server (625) The real-time reproduction program recorded on the recording medium of the terminal device is downloaded to the recording medium provided in the terminal device.
Also, the communication processing unit 620 may be configured to communicate with a predetermined communication network (e.g., TCP / IP based wired communication network, HSDPA (High Speed Downlink Packet Access) based wireless communication network, IEEE 802.16x based wireless communication network, (Or the messenger terminal 635) through a communication channel for downloading (or receiving) multimedia content to a predetermined content providing server 630 (or the messenger terminal 635) through the content providing server 630 (Or receiving) at least one multimedia content stored in a predetermined storage medium provided in the mobile terminal.
Referring to FIG. 6, the terminal including the real-time playback program may include a screen output unit 600 for outputting the video data of the multimedia content, a sound processing unit 605 for outputting the audio data of the multimedia content, And a key input unit 610 for inputting various keys for controlling the reproduction of the multimedia contents. The content providing server 630 (or the messenger terminal 635) and the communication for receiving the multimedia contents And a memory unit 615 for storing the downloaded multimedia contents, wherein the real-time playback program is a program for realizing a predetermined content When the download from the providing server 630 (or the messenger terminal 635) is not completed (or is being received ) Is characterized in that the predetermined multimedia content to be played back is played back in real time.
The screen output unit 600 outputs the video data of the multimedia contents decoded in the real time reproduction program in order to reproduce the multimedia contents downloaded (or received) through the communication processing unit 620 in real time (or in a streaming manner) And a screen outputting means for outputting the screen outputting means.
The sound processing unit 605 outputs the audio data of the multimedia content decoded in the real time reproduction program in order to reproduce the multimedia contents downloaded (or received) through the communication processing unit 620 in real time (or in a streaming manner) And a sound output means for outputting sound.
The memory unit 615 stores the received multimedia contents when predetermined multimedia contents are received from a predetermined content providing server 630 (or the messenger terminal 635), and the multimedia contents A header portion 693 including predetermined content header information, a video data portion 696 including predetermined video / audio data, and an index portion 699 including index information necessary for playing back the multimedia content .
The header portion 693 of the multimedia content is structure information positioned next to a FOURCC (FOUR Character Code) called "RIFF" of the multimedia content. The header portion 693 includes predetermined main header information, stream header information, At least one header information such as information, stream data, stream name, and the like.
The image data unit 696 preferably comprises a plurality of chunks configured by a predetermined data unit by interleaving predetermined video data and audio data, and the image data unit 696 may include image data (e.g., And audio data) are reproduced in the chunk unit.
According to an embodiment of the present invention, the image data portion 696 may include at least one data chunk directly described in the image data portion 696 ('movi') and at least one data chunk in a predetermined record And grouping them into chunks (&quot; rec &quot;).
The index unit 699 may include a chunk identifier for reproducing the image data in units of chunks, flag information, a chunk offset, and a chunk size.
Referring to FIG. 6, the real-time playback program controls the real-time playback program to operate based on a recording medium provided in the terminal device in cooperation with an operating system (or platform) provided in the terminal device, At least one function configuration unit constituting the real time reproduction program for real time reproduction is interlinked, and / or at least one function configuration unit provided in the terminal apparatus through an operating system (or a platform) And a main frame unit 640 (Mainframe) for performing a function for real time reproduction of the multimedia contents in cooperation with the above-mentioned components.
The main frame unit 640 is characterized in that the real time reproduction program includes a program execution code for being executed on an operating system (or a platform) provided in the terminal apparatus, The real time reproduction program is executed based on the operating system (or platform) provided in the terminal device in response to a predetermined program execution command.
In addition, the main frame unit 640 controls the at least one functional unit included in the real-time playback program to interoperate with each other in real-time playback of the multimedia content, The at least one functional component configuring the real-time playback program allocates an instance to the main frame unit 640 so that the functional components are cross-referenced and / or interlocked.
In addition, the main frame unit 640 may include at least one or more components (e.g., a key input unit 610 and / or a screen output unit 600) provided in the terminal device for real- (Or an interrupt) for accessing the terminal device (e.g., a terminal, a terminal, etc.) of the terminal device, And performs a unique function defined in each functional component.
In addition, the main frame unit 640 may include at least one or more components (e.g., a key input unit 610 and / or a screen output unit 600) provided in the terminal device for real- Or the like), and / or to access an input / output bus corresponding to a peripheral device provided in the terminal device, thereby making it possible to configure each function constituting the real time reproduction program And the units access the respective components provided in the terminal device and perform unique functions defined in the respective functional components.
6, the real-time playback program includes a content receiving unit 630 for receiving predetermined multimedia contents from a predetermined content providing server 630 (or messenger terminal 635) through the communication network in cooperation with the communication processing unit 620, And a content storage unit 690 for storing the received multimedia contents in the memory unit 615.
The content receiving unit 685 is configured to receive predetermined multimedia content to be received from a predetermined content providing server 630 (or the messenger terminal 635) provided on the communication network in cooperation with the communication processing unit 620 And the content receiving unit 685 sequentially receives the video data unit 696 and the index unit 699 from the header portion 693 of the multimedia content.
The content storage unit 690 stores the multimedia content received from the content providing server 630 (or the messenger terminal 635) in association with the communication processing unit 620 in the memory unit The content receiving unit 685 sequentially receives the multimedia content from the header unit 693 to the image data unit 696 and the index unit 699. The content storage unit 685 may store the multimedia content, The controller 690 also sequentially stores the received multimedia contents from the header portion 693 to the image data portion 696 and the index portion 699 in order.
According to the embodiment of the present invention, the content receiving unit 685 and the content storing unit 690 are included in a predetermined content reproducing unit (for example, a content reproducing program included in the terminal) .
According to another embodiment of the present invention, the content receiving unit 685 may be provided in predetermined browser communication means (for example, a browser program provided in the terminal apparatus, not shown) provided in the terminal apparatus, (For example, a messenger program included in the terminal device, not shown) provided in the terminal device.
6, the real-time playback program may include a content playback unit 650 for checking (or selecting) multimedia content to be played back among predetermined multimedia content stored (or stored) in the memory unit 615, (Or a content receiving unit 685) when it is determined that the multimedia content to be played back is a real-time playback target; and a real-time playback determining unit 645 that determines whether the playback target multimedia content is a real- A communication performance verification unit 665 periodically checking communication performance for downloading (or receiving) the multimedia contents to be reproduced, and a unit for periodically checking predetermined index generation unit capacity information corresponding to the confirmed communication performance A capacity information verifying unit 670, a storage unit for repeatedly checking the storage capacity of the received multimedia content, An information check unit 680 periodically checking whether the storage capacity of the multimedia contents reaches (or exceeds) the predetermined index generation unit capacity information, Extracts configuration information of a portion of the multimedia content file stored in the memory unit 615 to generate index information for each unit capacity when the storage capacity of the multimedia content file reaches (or exceeds) And an information generation unit 655 for generating index information for unit capacity for the multimedia contents based on the extracted configuration information. The content playback unit 650 may include a unit And the multimedia contents are reproduced based on capacity-specific index information.
The content reproducing unit 650 may check the multimedia contents to be reproduced among at least one or more multimedia contents stored (or stored) in the memory unit 615 in cooperation with the screen output unit 600 and the key input unit 610 (Or selects) the predetermined multimedia contents to be reproduced, and performs a predetermined initialization operation for reproducing the predetermined multimedia contents to be reproduced (or selected). In the initialization operation, the real- Reads the file information of the target multimedia contents and confirms whether the target multimedia content is included in the real-time playback object.
According to an embodiment of the present invention, the real-time reproduction determination unit 645 reads the file handle information (or the interrupt information on the file or the access right information of the file) of the multimedia contents to be reproduced, It is preferable to check whether the multimedia content to be played back is included in the real-time playback target by checking whether the target multimedia content is being received by the content receiving unit 685 or the multimedia content being stored by the content storage unit 690 Do.
If it is determined that the multimedia contents to be reproduced are being received by the content receiving unit 685 or that the content receiving unit 685 is not receiving the multimedia contents, Or if the multimedia content is being stored by the content storage unit 690, the multimedia content may be included in a real-time playback object.
According to another embodiment of the present invention, the real-time reproduction determination unit 645 determines whether a valid index unit 699 is included in the multimedia contents file based on the header information included in the header portion 693 of the reproduction- It is preferable to check whether the multimedia contents to be reproduced are included in the real-time reproduction object.
If the index part 699 is not included in the multimedia contents to be played back, the multimedia contents are preferably included in the real time playback object.
If it is determined that the multimedia content to be reproduced is not included in the real-time playback object, the content playback unit 650 may perform the multimedia content playback procedure according to the predetermined multimedia content playback procedure If the contents reproducing unit 650 has multimedia contents (for example, a file structure capable of streaming reproduction) included in the real-time reproduction object The multimedia content that has been downloaded, or the multimedia content that has been downloaded). Therefore, detailed description thereof will be omitted for the sake of convenience.
On the other hand, if it is determined that the playback target multimedia content is included in the real-time playback object, the real-time playback determination unit 645 transmits the playback target multimedia content information to the unit capacity information determination unit 670 And the storage capacity confirmation unit 675. [
The communication performance verifying unit 665 periodically checks the communication performance (Bytes / sec) corresponding to the downloading (or receiving) of the multimedia content in cooperation with the communication processing unit 620 (or the content receiving unit 685) And provides the confirmed communication performance information to the unit capacity information confirmation unit 670. [
According to the embodiment of the present invention, it is preferable that the communication performance verifying unit 665 confirms the communication performance before or before the multimedia contents are reproduced by the content reproducing unit 650. [
The unit capacity information determination unit 670 periodically confirms predetermined index generation unit capacity information corresponding to the confirmed communication performance.
According to an embodiment of the present invention, the unit capacity information determination unit 670 includes at least one or more communication performance information and index generation unit capacity information corresponding to each communication performance in association with each other (for example, When the communication capability corresponding to the download (or reception) of the multimedia contents is confirmed, the unit capacity information determination unit 670 checks the index generation unit capacity information corresponding to the confirmed communication performance .
According to another embodiment of the present invention, it is preferable that at least one communication performance information and index generation unit capacity information corresponding to each communication performance are linked and stored in the memory unit 615, The unit capacity information confirmation unit 670 checks the index generation unit capacity information corresponding to the confirmed communication performance in association with the memory unit 615. [
The storage capacity confirmation unit 675 periodically checks the storage capacity of the multimedia contents received through the content receiver 685 or stores the multimedia content in the memory unit 615 through the content storage unit 690 And the multimedia contents storage capacity is checked periodically.
The information verifying unit 680 checks whether the verified multimedia content storage capacity reaches (or exceeds) the identified index generation unit capacity, and when the index generation unit capacity is reached (or exceeded) It is preferable to confirm that the index information generation condition for each unit capacity for the multimedia contents is satisfied.
According to the embodiment of the present invention, after the i-th index generation unit capacity information is confirmed by the unit capacity information verifying unit 670, the information verifying unit 680 checks the storage capacity verifying unit 675 (Or exceeds) the i-th index storage unit capacity, and when the i-th index storage unit capacity reaches (or exceeds) the i-th index storage unit capacity, the information checker 680 stores the It is preferable to confirm that the condition for generating index information for each i-th unit capacity is satisfied.
Alternatively, when the index generation unit capacity information changes in real time due to the non-reproduction time (or frame) fluctuating in real time, the information verification unit 680 may determine that the i &lt; th &gt; storage capacity (Or exceeds) the index generation unit capacity confirmed by the non-reproduction time (or frame) variation. When the variable index generation unit capacity reaches (or exceeds) the index generation unit capacity, It is preferable to confirm that the condition for generating the index information for each unit capacity is satisfied.
According to the embodiment of the present invention, after the i-th index generation unit capacity information is confirmed by the unit capacity information determination unit 670, the information verification unit 680 determines whether the non-reproduction time (or frame) The i-th storage capacity identified through the storage capacity checker 675 is stored in the i-th index generation unit (s) identified by the non-reproduction time (or frame) variation, (Or exceeds) the capacity, and when the i-th index generating unit capacity reaches (or exceeds) the capacity, the information verifying unit 680 satisfies the i-th unit capacity index information generating condition for the multimedia contents It is desirable to confirm that
Alternatively, if the index generation unit capacity information changes in real time due to the non-reproduction time (or frame) fluctuating in real time, the information generation unit 680 may determine that the index generation unit capacity information is the predetermined data And if the index generation unit capacity information is smaller than a predetermined data chunk size included in the multimedia content, the index generation unit is configured to satisfy the unit information generation index condition for the multimedia content It is desirable to confirm.
According to the embodiment of the present invention, after the i-th index generation unit capacity information is confirmed by the unit capacity information determination unit 670, the information verification unit 680 determines whether the non-reproduction time (or frame) When the i-th index generation unit capacity information is changed in real time and the i-th index generation unit capacity information is smaller than a predetermined data chunk size included in the multimedia contents, the information checker 680 stores the i- It is preferable to confirm that the index information generation condition for each i-th unit capacity of the multimedia contents is satisfied regardless of whether the generation unit capacity is reached (or exceeded).
Alternatively, when the reproduction time corresponding to the current reproduction frame of the multimedia contents reaches (or exceeds) the scheduled reproduction time (or the number of frames), the information verification unit 680 determines whether or not the new unit capacity It is preferable to confirm that the index information generation condition is satisfied.
According to the embodiment of the present invention, after the i-th index generation unit capacity information is confirmed by the unit capacity information verification unit 670, the non-reproduction time (or frame) When the reproduction time corresponding to the current reproduction frame of the multimedia content reaches the expected reproduction time (or the number of frames) in real time, the information verification unit 680 determines the i-th unit capacity It is preferable to confirm that the condition for generating the star index information is satisfied.
If it is confirmed by the information verifying unit 680 that the index information generation condition for each unit capacity is satisfied, the information extracting unit 660 extracts the index information for each unit capacity, And extracts the configuration information of a portion of the multimedia content file stored in the storage unit 615.
According to an embodiment of the present invention, the information extractor 660 extracts header information for the multimedia content by reading the header portion 693 of the multimedia content, and extracts header information of the multimedia content based on the header information, It is preferable to extract data chunk information including at least one format, position and size of at least one data chunk included in the image data portion 696 based on the character code and the size of the data chunk.
For example, the information extracting unit 660 may check the size of the first data chunk including the first character code (e.g., 00db, 00dc, 00pc, or 00wb) of the first data chunk and the actual stream data, (E.g., 01db, or 01dc, or 01pc, or 01wb) after the first data chunk, wherein the second character chunk of the second data chunk identifies the actual stream data of the first data chunk It will be located next.
If the information extracting unit 660 verifies the second character code and the size and actual stream data of the nth (n > 1) data chunk, then the (n + 1) If the chunk character code of the chunk is not confirmed, if the n-th data chunk is regarded as damaged, the information extractor 660 shifts the actual stream data of the n-th data chunk by one byte It is preferable to check the first character code and size and actual stream data of the (n + 1) -th data chunk after retrieving the second character code of the (n + 1) -th data chunk, .
When the data chunk information including at least one of the format, position, and size of at least one data chunk included in the image data unit 696 is extracted, the information generation unit 655 generates the data chunk information Unit index information for unit capacity to reproduce the multimedia contents is generated on the basis of the unit capacity index information, wherein the unit capacity index information is generated in the form of an AVI index structure.
Hereinafter, the content reproducing unit 650 reproduces the multimedia contents to be reproduced based on the unit capacity index information generated by the information generating unit 655.
According to the embodiment of the present invention, the communication performance verifying unit 665 confirms the communication performance information of the multimedia contents in cooperation with the communication processing unit 620 (or the content receiving unit 685) The storage capacity verification unit 675 checks the index generation unit capacity corresponding to the confirmed communication performance and stores the received multimedia content in association with the content reception unit 685 (or the content storage unit 690) The information checking unit 680 checks whether the storage capacity of the multimedia content reaches (or exceeds) the identified index generation unit capacity information, and if the information extraction unit 660 determines that the storage capacity of the multimedia content reaches Extracts the configuration information of a portion of the multimedia content file stored in the storage unit 615, and the information generation unit 655 extracts configuration information of the multimedia content file based on the extracted configuration information, The process of generating the index information for each unit capacity for the content is performed by receiving all of the multimedia contents through the content receiving unit 685 and storing the multimedia contents received through the content storage unit 690 in the memory unit 615 ) Until it is stored.
When the multimedia contents are all received / stored through the content receiver 685 and the content storage unit 690, the information generator 655 generates final index information on the multimedia contents. The content reproduction unit 650 reproduces the multimedia content based on the final index information.
7 is a diagram showing a real-time reproduction of multimedia contents according to a third embodiment of the present invention.
In more detail, FIG. 7 illustrates a real-time playback program provided to the terminal device shown in FIG. 6 when the multimedia content including the content structure shown in FIG. 1 is played back, 7 is a flowchart illustrating a process of real-time playback (or playback by streaming) of the multimedia contents by referring to and / or modifying the FIG. 7 if a person skilled in the art is familiar with the process It is to be understood that the invention may be practiced otherwise than as specifically described herein. The invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein.
Hereinafter, in FIG. 7, the terminal device shown in FIG. 6 having the real-time playback program is referred to as a "terminal" for the sake of convenience.
Referring to FIG. 7, the terminal selects one or more predetermined multimedia contents to be played back by the terminal, among at least one multimedia contents provided in a content providing server 630 (or messenger terminal 635) (700) and executes the real-time playback program shown in FIG. 6 to receive the multimedia content to be played back provided by the content providing server 630 (or the messenger terminal 635) (705) If the header portion 693 of the multimedia contents is received (710), the header information of the multimedia contents to be reproduced is read and it is checked whether the multimedia contents to be reproduced are included in the real time reproduction object (715).
According to an embodiment of the present invention, the terminal reads the file handle information (or the interrupt information on the file or the access right information of the file) of the multimedia contents to be played back, It is preferable to check whether the multimedia content to be reproduced is included in the real-time playback object by checking whether the multimedia content is being received by the receiving unit 685 or being stored by the content storage unit 690.
According to another embodiment of the present invention, the terminal determines whether a valid index unit 699 is included in the multimedia content file based on the header information included in the header part 693 of the playback target multimedia content , It is preferable to check whether the multimedia contents to be reproduced are included in the real-time reproduction object.
If the multimedia content to be reproduced is not included in the real-time playback object (720), the terminal plays the multimedia content to be played according to a predetermined multimedia content playback procedure (725).
If the multimedia content to be played back is included in the real-time playback object (720), the terminal checks the first (i = 1) communication performance information for the multimedia content being received (730).
If the first (i = 1) communication capability information is confirmed (735), the terminal generates a first (i = 1) communication capability information based on the first The generation unit capacity information is checked (740).
If the first (i = 1) index generation unit capacity information is confirmed (745), the terminal transmits the capacity of the multimedia contents to be reproduced received from the content providing server 630 (or the messenger terminal 635) By checking whether the first (i = 1) multimedia content storage capacity reaches (or exceeds) the first (i = 1) index generation unit capacity, (750).
If it is determined in step 755 that the index information generation condition for the first (i = 1) unit capacity is satisfied (step 755), the terminal extracts header information and data chunk information for the multimedia content to be played back in step 760.
According to an embodiment of the present invention, the terminal reads header information of the multimedia content by reading the header part 693 of the multimedia content, extracts header information of the multimedia content from the header character code of the data chunk, Location, and size of at least one or more data chunks included in the image data portion 696 based on the size of the data chunks.
Then, the terminal generates 765 the first (i = 1) unit capacity index information for reproducing the received multimedia contents on the basis of the extracted header information and the data chunk information, the first (i = 1) multimedia contents reproducing area is decoded and reproduced (step 770) based on index information of each unit capacity (i = 1), and it is determined whether all the multimedia contents being reproduced are received (step 775).
If all of the multimedia contents are not received (780), the UE confirms the second (i = i + 1) communication performance information for the multimedia contents being received (785) Capacity index information generation condition on the basis of the index generation unit capacity information and generates index information for each unit capacity according to a result of the checking, Is repeated.
If the multimedia contents are all received (780), the terminal generates final index information for the multimedia contents to be played back (790), decodes the multimedia contents through the generated final index information, (795).
More specifically, FIG. 8 illustrates a case where predetermined multimedia content (for example, including a file structure capable of streaming playback) that has not been downloaded (or is being received) from a predetermined content providing server 830 (or messenger terminal 835) (E.g., a desktop computer, a notebook computer, a mobile communication terminal, a portable Internet terminal, a wireless LAN terminal, a bidirectional digital TV, an IPTV, or the like) in order to reproduce the multimedia contents The present invention relates to a desired functional configuration of a real-time playback program, and more particularly, to a multimedia content playback apparatus capable of periodically reproducing communication performance of predetermined multimedia contents downloaded (or receiving) , And checks whether or not a predetermined (Or receiving) predetermined multimedia contents based on the predetermined index generation unit capacity information corresponding to the confirmed communication performance, based on the unit capacity of the predetermined multimedia contents And index information is periodically generated to reproduce the multimedia contents in real time (or in a streaming manner).
For example, although it is shown in FIG. 8 that a function of downloading predetermined multimedia content that has not been downloaded from a predetermined content providing server 830 (or messenger terminal 835) is provided in the real-time playback program, The present invention is not limited thereto and the function of downloading the multimedia contents may be provided in an application program other than the real time reproduction program (for example, a browser program or a messenger program included in the terminal device) The present invention is not limited thereto.
Referring to FIG. 8 according to an embodiment of the present invention, the terminal device may be a wired communication network based on a predetermined communication network (for example, TCP / IP) or a High Speed Downlink Packet Access (HSDPA) And a communication processing unit 820 for connecting a communication channel to a predetermined server (or terminal) through a communication network, an IEEE 802.16x based wireless communication network, or the like.
The communication processing unit 820 is connected to the terminal device through a predetermined communication network (for example, a TCP / IP based wired communication network, HSDPA (High Speed Downlink Packet Access) based wireless communication network, IEEE 802.16x based wireless communication network, A program providing server 825 for storing and managing a real time reproduction program and transmitting the real time reproduction program to the terminal device, The real-time reproduction program recorded on the recording medium of the terminal device is downloaded to the recording medium provided in the terminal device.
Also, the communication processing unit 820 may be connected to a predetermined communication network (e.g., TCP / IP based wired communication network, HSDPA (High Speed Downlink Packet Access) based wireless communication network, IEEE 802.16x based wireless communication network, (Or the messenger terminal 835) through a communication channel for downloading (or receiving) multimedia content to a predetermined content providing server 830 (or the messenger terminal 835) through the content providing server 830 (Or receiving) at least one multimedia content stored in a predetermined storage medium provided in the mobile terminal.
Referring to FIG. 8, the terminal device having the real-time playback program may include a screen output unit 800 for outputting video data of the multimedia content, a sound processing unit 805 for outputting audio data of the multimedia content, And a key input unit 810 for inputting various keys for controlling the reproduction of the multimedia contents. The predetermined contents providing server 830 (or the messenger terminal 835) and the communication for receiving the multimedia contents A communication processor 820 for connecting and managing channels and a memory 815 for storing the downloaded multimedia contents, wherein the real-time playback program is a program for realizing a predetermined content When the download from the providing server 830 (or the messenger terminal 835) is not completed ) Is characterized in that the predetermined multimedia content to be played back is played back in real time.
The screen output unit 800 outputs the video data of the multimedia contents decoded in the real time reproduction program in order to reproduce the multimedia contents downloaded (or received) through the communication processing unit 820 in real time (or in a streaming manner) And a screen outputting means for outputting the screen outputting means.
The sound processing unit 805 outputs the audio data of the multimedia contents decoded in the real time reproduction program in order to reproduce the multimedia contents downloaded (or received) through the communication processing unit 820 in real time (or in a streaming manner) And a sound output means for outputting sound.
The memory unit 815 stores the received multimedia contents when predetermined multimedia contents are received from a predetermined content providing server 830 (or the messenger terminal 835), and the multimedia contents A header portion 893 including predetermined content header information, a video data portion 896 including predetermined video / audio data, and an index portion 899 including index information necessary for reproducing the multimedia content .
The header part 893 of the multimedia content is structured information that is positioned next to a FOURCC character code (hereinafter referred to as a "RIFF") of the multimedia content. The header part 893 includes predetermined main header information, stream header information, At least one header information such as information, stream data, stream name, and the like.
The video data unit 896 preferably comprises a plurality of chunks configured by a predetermined data unit by interleaving predetermined video data and audio data. The video data unit 896 may include video data (e.g., And audio data) are reproduced in the chunk unit.
According to an embodiment of the present invention, the video data unit 896 may include at least one data chunk directly described in the video data unit 896 ('movi') and at least one data chunk in a predetermined record And grouping them into chunks (&quot; rec &quot;).
The index unit 899 preferably includes a chunk identifier, flag information, a chunk offset, and a chunk size for reproducing the image data in units of chunks.
Referring to FIG. 8, the real-time playback program controls the real-time playback program to operate based on a recording medium included in the terminal device in cooperation with an operating system (or platform) provided in the terminal device, At least one function configuration unit constituting the real time reproduction program for real time reproduction is interlinked, and / or at least one function configuration unit provided in the terminal apparatus through an operating system (or a platform) And a main frame unit 840 (Mainframe) for performing a function for real-time playback of the multimedia contents in cooperation with the above-described components.
The main frame unit 840 is characterized in that the real time reproduction program includes a program execution code for being executed on an operating system (or a platform) provided in the terminal apparatus, The real time reproduction program is executed based on the operating system (or platform) provided in the terminal device in response to a predetermined program execution command.
In addition, the main frame unit 840 controls the at least one functional unit included in the real-time playback program to interwork with each other for real-time playback of the multimedia content. The at least one functional component configuring the real-time playback program allocates an instance to the main frame unit 840 so that the functional components are cross-referenced and / or interlocked.
In addition, the main frame unit 840 may include at least one or more components (for example, a key input unit 810 and / or a screen output unit 800) provided in the terminal device for real- (Or an interrupt) for accessing the terminal device (e.g., a terminal, a terminal, etc.) of the terminal device, And performs a unique function defined in each functional component.
In addition, the main frame unit 840 may include at least one or more components (for example, a key input unit 810 and / or a screen output unit 800) provided in the terminal device for real- Or the like), and / or to access an input / output bus corresponding to a peripheral device provided in the terminal device, thereby making it possible to configure each function constituting the real time reproduction program And the units access the respective components provided in the terminal device and perform unique functions defined in the respective functional components.
8, the real-time playback program includes a content receiving unit 830 for receiving predetermined multimedia contents from a predetermined content providing server 830 (or messenger terminal 835) through the communication network in cooperation with the communication processing unit 820, And a content storage unit 890 for storing the received multimedia content in the memory unit 815. [
The content receiving unit 885 is configured to receive predetermined multimedia content to be received from a predetermined content providing server 830 (or messenger terminal 835) provided on the communication network in cooperation with the communication processing unit 820 And the content receiving unit 885 sequentially receives the video data unit 896 and the index unit 899 from the header portion 893 of the multimedia content.
The content storage unit 890 stores the multimedia contents received from the content providing server 830 (or the messenger terminal 835) in association with the communication processing unit 820 in the memory unit 815. When the content receiver 885 sequentially receives the multimedia content from the header 893 to the video data unit 896 and the index unit 899, The controller 890 also sequentially stores the received multimedia contents from the header portion 893 to the video data portion 896 and the index portion 899. [
According to the embodiment of the present invention, the content receiving unit 885 and the content storing unit 890 are included in a predetermined content reproducing unit (for example, a content reproducing program included in the terminal device) .
According to another embodiment of the present invention, the content receiving unit 885 may be provided in predetermined browser communication means (for example, a browser program provided in the terminal apparatus, not shown) provided in the terminal apparatus, In this case, the content receiver 885 may receive predetermined unit capacity information (for example, a predetermined unit capacity information) included in the terminal device, It is preferable to be provided so as to be interlocked with the confirmation unit 870.
Referring to FIG. 8, the real-time playback program includes a content playback unit 850 for playing back predetermined multimedia content stored (or stored) in the memory unit 815, (860) for extracting configuration information of a portion of a multimedia content file stored in the memory unit (815) when it is determined that the multimedia content to be played back is a real time playback target, And an information generation unit 855 for generating index information for each unit capacity of the multimedia contents based on the extracted configuration information. The content playback unit 850 may be configured to display the unit capacity information And reproduces the multimedia contents based on the index information.
The content reproducing unit 850 may check the multimedia contents to be reproduced among at least one or more multimedia contents stored (or stored) in the memory unit 815 in cooperation with the screen output unit 800 and the key input unit 810 (Or selects) the predetermined multimedia contents, and performs predetermined initialization to reproduce the predetermined multimedia contents to be reproduced (or selected). In the initialization operation, the real-time reproduction determination unit 845 determines Reads the file information of the target multimedia contents and confirms whether the target multimedia content is included in the real-time playback object.
According to an embodiment of the present invention, the real-time reproduction determination unit 845 reads the file handle information (or the interrupt information on the file or the access right information of the file) of the multimedia contents to be reproduced, It is preferable to check whether the multimedia content to be played back is included in the real-time playback object by checking whether the target multimedia content is being received by the content receiver 885 or the multimedia content being stored by the content storage unit 890 Do.
If the multimedia contents to be reproduced are received by the contents receiver 885 or if the multimedia contents are received by the contents receiving unit 885 as a result of reading the file handle information (or the interrupt information on the file or the access right information of the file) Or if the multimedia content is being stored by the content storage unit 890, the multimedia content may be included in a real-time playback object.
According to another embodiment of the present invention, the real-time reproduction determination unit 845 determines whether a valid index unit 899 is included in the multimedia content file based on the header information included in the header portion 893 of the multimedia content to be reproduced It is preferable to check whether the multimedia contents to be reproduced are included in the real-time reproduction object.
If the index part 899 is not included in the multimedia contents to be played back, the multimedia contents are preferably included in the real time playback object.
If it is determined that the multimedia content to be played back is not included in the real-time playback object, the content playback unit 850 may perform the multimedia content playback procedure according to the predetermined multimedia content playback procedure If the content reproducing unit 850 has multimedia contents (for example, a file structure capable of streaming playback) included in the real-time playback object The multimedia content that has been downloaded, or the multimedia content that has been downloaded). Therefore, detailed description thereof will be omitted for the sake of convenience.
On the other hand, if it is determined that the multimedia contents to be reproduced are included in the real-time playback object as a result of the determination of the real-time playback determination unit 845, the real-time playback determination unit 845 transmits the multimedia content information to be played back to the information extraction unit 860 Unit capacity information verifying unit 870.
The information extracting unit 860 extracts configuration information of a portion of the multimedia content file stored in the memory unit 815 in order to generate predetermined unit capacity index information.
According to an embodiment of the present invention, the information extracting unit 860 extracts header information for the multimedia content by reading the header portion 893 of the multimedia content, and extracts header information of the multimedia content based on the header information, It is preferable to extract data chunk information including at least one format, position and size of at least one data chunk included in the image data portion 896 based on the character code and the size of the data chunk.
For example, the information extracting unit 860 may check the size of the first data chunk including the second character code (e.g., 00db, 00dc, 00pc, or 00wb) of the first data chunk and the actual stream data, (E.g., 01db, or 01dc, or 01pc, or 01wb) after the first data chunk, wherein the second character chunk code of the second data chunk identifies the actual stream data of the first data chunk It will be located next.
If the information extracting unit 860 verifies the first character code and the size and actual stream data of the nth (n > 1) data chunk, then the (n + 1) If the chunk character code of the chunk is not confirmed, if the n-th data chunk is regarded as damaged, the information extracting unit 860 shifts the actual stream data of the n-th data chunk by one byte It is preferable to check the first character code and size and actual stream data of the (n + 1) -th data chunk after retrieving the second character code of the (n + 1) -th data chunk, .
When the data chunk information including at least one of the format, position, and size of at least one data chunk included in the image data unit 896 is extracted, the information generation unit 855 generates the data chunk information Unit index information for unit capacity to reproduce the multimedia contents is generated on the basis of the unit capacity index information, wherein the unit capacity index information is generated in the form of an AVI index structure.
Hereinafter, the content reproducing unit 850 reproduces the multimedia contents to be reproduced on the basis of the unit capacity index information generated by the information generating unit 855.
Referring to FIG. 8, when the multimedia contents to be played back are determined to be a real-time playback object, the real-time playback program downloads the multimedia contents to be played back in association with the communication processing unit 820 (or the content receiving unit 885) A unit capacity information checking unit 870 periodically checking predetermined index generation unit capacity information corresponding to the confirmed communication performance, An information checking unit 880 for periodically checking whether the storage capacity of the multimedia contents reaches (or exceeds) the predetermined index generating unit capacity information, a storage capacity checking unit for repeatedly checking the storage capacity of the multimedia contents, And the storage capacity of the multimedia contents is the same as the index generation unit capacity (860) for extracting configuration information of a portion of the multimedia content file stored in the memory unit (815) to generate predetermined index information for each unit capacity, and an extraction unit And an information generating unit 855 for generating unit-capacity-specific index information for the multimedia contents. The content reproducing unit 850 generates the multimedia content based on the index information for each unit capacity. Is reproduced.
On the other hand, if it is determined that the playback target multimedia content is included in the real-time playback object as a result of the determination of the real-time playback determination unit 845, the real-time playback determination unit 845 transmits the playback target multimedia content information to the unit capacity information determination unit 870 And a storage capacity confirmation unit 875. [
The communication performance verifying unit periodically checks the communication performance (Bytes / sec) corresponding to the downloading (or receiving) of the multimedia content in cooperation with the communication processing unit 820 (or the content receiving unit 885) And provides the confirmed communication performance information to the unit capacity information confirmation unit 870.
The unit capacity information determination unit 870 periodically confirms predetermined index generation unit capacity information corresponding to the confirmed communication performance.
According to an embodiment of the present invention, the unit capacity information determination unit 870 includes at least one or more communication performance information and index generation unit capacity information corresponding to each communication performance in association with each other (for example, If the communication capability corresponding to the download (or reception) of the multimedia contents is confirmed, the unit capacity information check unit 870 checks the index generation unit capacity information corresponding to the confirmed communication performance .
According to another embodiment of the present invention, it is preferable that at least one communication performance information and index generation unit capacity information corresponding to each communication performance are linked and stored in the memory unit 815, Reception unit), the unit capacity information determination unit 870 checks the index generation unit capacity information corresponding to the confirmed communication performance in association with the memory unit 815. [
If the communication capability information is confirmed, the unit capacity checking unit may determine a predetermined unit capacity index for generating the predetermined unit capacity index information for seamlessly reproducing the multimedia contents based on the confirmed communication performance information And the capacity-specific index information is confirmed.
According to the embodiment of the present invention, the unit capacity information check unit 870 checks the playback scheduled (number of frames) information of the playback target multimedia contents received so far based on the header information of the playback target multimedia content desirable.
For example, the unit capacity information determination unit 870 may determine the unit capacity information based on the frame rate information (dwMicroSecPerFrame), the data rate information (dwMaxBytesPerSec) included in the header information of the playback target multimedia content, and the at least one data chunk (Number of frames) information of the multimedia contents to be played back so far by using at least one of the information and the reception capacity information.
Hereinafter, the unit capacity information determination unit 870 may multiply the communication capability information and the playback schedule (number of frames) to receive the playback target multimedia content before all of the playback target multimedia contents received up to now are reproduced (i + 1) th maximum receiving capacity information.
Here, the i &lt; th &gt;
(Number of frames) (number of frames) is to be reproduced
(I + 1) &lt; th &gt; largest received capacity information
If the content receiving unit 885 keeps receiving the remaining portion of the multimedia contents to be played back by the communication performance or more in reproducing the multimedia contents to be played so far, the (i + 1) The reception capacity information may be used as (i + 1) th unit capacity index information as it is.
On the other hand, since the actual communication performance does not hold more than the confirmed communication performance information while receiving the remaining portion of the multimedia contents, the (i + 1) th unit capacity index information is stored in the (i + If the capacity information includes a predetermined proportional constant
According to the method of the present invention, the lowest communication performance during reception of the i-th multimedia content
, The proportional constant
Those of ordinary skill in the art will appreciate that the proportional constants defined above
In addition, various proportional constants may be deduced, but the present invention is characterized in that it comprises all the above-mentioned embodiments, and is not limited by a specific proportional constant.
In addition, while the multimedia contents are reproduced, the multimedia contents may be sequentially reproduced. However, the user may skip some reproduction time (or frame) at the request of the viewer of the multimedia contents.
Here, if the non-playing time (or frame) skipping during playback of the i-th multimedia content is denoted by (i + 1) th unit capacity index information
In particular, the non-playing time (or frame)
Quot ;, and is varied during reproduction of the i-th multimedia content, whereby the unit capacity information determination unit 870 determines the (i + 1) th unit capacity index information Then, the non-reproduction time (or frame)
It is preferable that the (i + 1) -th unit-specific index information is reaffirmed every time the value of the (i + 1) -th unit capacity is varied.
When the unit capacity information determination unit 870 determines the (i + 1) th unit capacity index information, the total capacity of the playback target multimedia content is
, It is preferable that the index generation unit capacity information is confirmed to satisfy the following condition.
The storage capacity check unit 875 periodically checks the storage capacity of the multimedia contents received through the content receiver 885 or stores the multimedia contents in the memory unit 815 through the content storage unit 890 And the multimedia contents storage capacity is checked periodically.
The information verifying unit 880 determines whether the verified multimedia content storage capacity reaches (or exceeds) the identified index generation unit capacity, and when the index generation unit capacity is reached (or exceeded) It is preferable to confirm that the index information generation condition for each unit capacity for the multimedia contents is satisfied.
According to the embodiment of the present invention, the information verifying unit 880 verifies the i-th index generating unit capacity information by the unit capacity information verifying unit 870, (Or exceeds) the i-th index storage unit capacity, and if the i-th index storage unit capacity reaches (or exceeds) the i-th index storage unit capacity, the information checking unit 880 It is preferable to confirm that the condition for generating index information for each (i + 1) th unit capacity is satisfied.
Alternatively, when the index generation unit capacity information changes in real time due to the real time variation of the non-reproduction time (or frame), the information verification unit 880 may determine that the i &lt; th &gt; storage capacity (Or exceeds) the index generation unit capacity confirmed by the non-reproduction time (or frame) variation. When the variable index generation unit capacity reaches (or exceeds) the index generation unit capacity, It is preferable to confirm that the condition for generating the index information for each unit capacity is satisfied.
According to the embodiment of the present invention, after the i-th index generating unit capacity information is confirmed by the unit capacity information verifying unit 870, the information verifying unit 880 determines whether the non-reproducing time (or frame) The i-th storage capacity identified through the storage capacity check unit 875 is stored in the i-th index generation unit (s) identified by the non-reproduction time (or frame) (I + 1) -th unit capacity index information for the multimedia contents when the i-th index unit capacity is reached (or exceeded) It is preferable to confirm that the generation condition is satisfied.
Alternatively, if the index generation unit capacity information changes in real time due to the real-time variation of the non-reproduction time (or frame), the information generation unit 880 determines that the index generation unit capacity information is the predetermined data And if the index generation unit capacity information is smaller than a predetermined data chunk size included in the multimedia content, the index generation unit is configured to satisfy the unit information generation index condition for the multimedia content It is desirable to confirm.
According to the embodiment of the present invention, after the i-th index generating unit capacity information is confirmed by the unit capacity information verifying unit 870, the information verifying unit 880 checks whether the non-reproducing time (or frame) If the i-th index generation unit capacity information becomes smaller than a predetermined data chunk size included in the multimedia content when the i-th index generation unit capacity information changes in real time, the information checker 880 determines the i- It is preferable to confirm that the index information generation condition for each (i + 1) th unit capacity for the multimedia contents is satisfied regardless of whether the generation unit capacity is reached (or exceeded).
Alternatively, when the reproduction time corresponding to the current reproduction frame of the multimedia contents reaches (or exceeds) the scheduled reproduction time (or the number of frames), the information verification unit 880 determines whether or not the new unit capacity It is preferable to confirm that the index information generation condition is satisfied.
According to the embodiment of the present invention, after the i-th index generation unit capacity information is confirmed by the unit capacity information determination unit 870, the non-reproduction time (or frame) When the reproduction time corresponding to the current reproduction frame of the multimedia contents reaches the expected reproduction time (or the number of frames) in real time, the information verification unit 880 identifies (i + 1) ) &Lt; th &gt; unit capacity-by-unit capacity index information generation condition is satisfied.
When it is confirmed by the information verifying unit 880 that the index information generation condition for each new unit capacity for the multimedia content is satisfied, the information extracting unit 860 extracts the unit capacity- And extracts the configuration information of a portion of the multimedia content file stored in the storage unit 815.
According to the embodiment of the present invention, the communication capability confirmation unit confirms the communication capability information of the multimedia contents in association with the communication processing unit 820 (or the content reception unit 885), and the unit capacity confirmation unit confirms the confirmed communication And the storage capacity checking unit 875 repeatedly checks the storage capacity of the received multimedia content in association with the content receiving unit 885 (or the content storage unit 890) The information checking unit 880 checks whether the storage capacity of the multimedia contents reaches (or exceeds) the identified index generating unit capacity information, and the information extracting unit 860 extracts, from the memory unit 815, Extracts the configuration information of a portion of the multimedia content file stored in the multimedia information storage unit 855, The process of generating the index information for each unit of content may include receiving all the multimedia contents through the content receiving unit 885 and storing the multimedia contents received through the content storage unit 890 in the memory unit 815, Until it is stored in the memory.
If the multimedia contents are all received / stored through the content receiver 885 and the content storage 890, the information generator 855 generates final index information for the multimedia contents. The content reproduction unit 850 reproduces the multimedia content based on the final index information.
9 is a view showing a real-time reproduction of multimedia contents according to a fourth embodiment of the present invention.
9 is a flowchart illustrating a method for real time reproduction (or streaming) multimedia contents in the case where a real time reproduction program provided in the terminal shown in FIG. 8 reproduces multimedia contents including the contents structure shown in FIG. (Or reproducing in a streaming manner) the multimedia contents by referring to and / or modifying the FIG. 9 if the person skilled in the art is familiar with the present invention It is to be understood that the present invention is not limited to the above-described embodiments, and various modifications may be made without departing from the spirit and scope of the invention.
Hereinafter, in Fig. 9, the terminal device shown in Fig. 8 having the real-time playback program is referred to as "terminal" for the sake of convenience.
9, the terminal executes the real-time playback program shown in FIG. 8 to select a predetermined multimedia content to be played back among at least one or more multimedia contents stored (or stored) in the memory unit 815 (900), the terminal reads the file information of the multimedia content to be played back, and determines whether the multimedia content to be played back is included in the real-time playback object (for example, (905) whether the multimedia content to be reproduced has been completely downloaded from the predetermined content providing server 830 (or the messenger terminal 835).
According to an embodiment of the present invention, the terminal reads the file handle information (or the interrupt information on the file or the access right information of the file) of the multimedia contents to be played back, It is preferable to check whether the multimedia contents to be reproduced are included in the real time reproduction target by checking whether the multimedia contents are being received by the receiving unit 885 or being stored by the content storage unit 890. [
According to another embodiment of the present invention, the terminal determines whether a valid index unit 899 is included in the multimedia content file based on the header information included in the header part 893 of the playback target multimedia content , It is preferable to check whether the multimedia contents to be reproduced are included in the real-time reproduction object.
If the multimedia content to be played back is not included in the real-time playback object (910), the terminal plays the multimedia content to be played according to a predetermined multimedia content playback procedure (915).
Meanwhile, if the multimedia contents to be reproduced are included in the real-time playback object (910), the terminal receives header information for the multimedia contents to be reproduced received from the contents providing server 830 (or messenger terminal 835) Data chunk information is extracted (920).
According to an embodiment of the present invention, the terminal reads the header part 893 of the multimedia content to extract header information for the multimedia content, and based on the header information, Location and size of at least one or more data chunks included in the image data portion 896 based on the size of the data chunks.
Then, the terminal generates a first (i = 1) unit capacity index information for reproducing the multimedia contents received up to now based on the extracted header information and the data chunk information (925) The first (i = 1) multimedia contents reproducing area is decoded and reproduced on the basis of 1 (i = 1) unit capacity index information (step 930).
Then, the MS confirms the first (i = 1) communication capability information for the first (i = 1) multimedia content area among the multimedia contents being received (935).
If the first (i = 1) communication capability information is confirmed (940), the UE determines whether or not the scheduled replaying time (or the number of frames) of the replayed multimedia content received so far based on the header information of the replayed multimedia content ) Information (945).
According to an embodiment of the present invention, the terminal may store frame rate information (dwMicroSecPerFrame), data rate information (dwMaxBytesPerSec) included in header information of the playback target multimedia content, and at least one data chunk information included in the playback target multimedia content It is preferable that at least one storage capacity information is used to confirm the scheduled reproduction time information of the multimedia contents to be reproduced which has been received so far.
Then, the terminal generates a second (i + 1) index generation unit (i + 1) based on the first (i = 1) communication performance and the first The capacity information is confirmed (950).
If the second (i + 1) th index generation unit capacity information is confirmed in step 955, the terminal generates a predetermined non-reproduction time (or frame) (for example, (Or frame) that is skipped by the request of the user (step 960).
If a predetermined non-playing time (or frame) occurs during playback of the first (i = 1) multimedia content playback area, the terminal determines whether the first (i = 1) (i + 1) th index generation unit capacity information including the non-reproduction time (or frame) at the scheduled reproduction time (i = 1).
If the second (i + 1) th multimedia contents storage capacity of the multimedia contents to be played received from the content providing server 830 (or the messenger terminal 835) is greater than the second (i + 1) (I + 1) unit capacity index information generation condition is satisfied (975) by checking whether the index generation unit capacity is reached (or exceeded).
According to another embodiment of the present invention, after the first (i = 1) index generation unit capacity information is confirmed, the terminal changes the non-reproduction time (or frame) (I + 1) storage capacity by checking whether the first (i = 1) storage capacity reaches (or exceeds) the index generation unit capacity identified by the non-reproduction time (or frame) It is preferable to confirm whether or not the index information generation condition for each unit capacity is satisfied.
According to still another embodiment of the present invention, after the first (i = 1) index generation unit capacity information is confirmed, the terminal changes the non-reproduction time (or frame) (I + 1) -th unit capacity index information by checking whether the first (i = 1) index generation unit capacity information is smaller than a predetermined data chunk size included in the multimedia contents, It is preferable to confirm whether or not the condition is satisfied.
If it is confirmed that the index information generation condition for the second (i + 1) unit capacity is satisfied (980), the terminal determines whether all of the multimedia contents to be played back have been received (985)
If all of the multimedia contents to be reproduced are not received at the time of satisfying the index information generation condition for the second (i + 1) unit capacity (990), the terminal transmits the second (i + 1) (I + 1) unit capacity index information is generated (992) by extracting file information and data chunk information about the storage capacity of the first (i + 1) (I + 1) th multimedia content reproduction region by decoding and reproducing the second (i + 1) th multimedia content reproduction region in step 994, and generates index information for each unit capacity for the multimedia content. .
On the other hand, if all of the multimedia contents to be played back have been received (990) at a time point satisfying the index information generation condition for the second (i + 1) unit capacity, the terminal generates final index information for the multimedia contents to be played back (Step 996). The multimedia content is decoded and reproduced through the generated final index information (step 998).
200: screen output unit 205: sound processing unit
210: key input unit 215: memory unit
220: communication processing unit 225: program providing server
230: content providing server 235: messenger terminal
240: main frame unit 245: content playback unit
250: information generating unit 255: information extracting unit
260: real-time reproduction judgment unit 265:
270: Information verification unit 275: Content reception unit
280: Content storage unit 285:
290: image data portion 295: index portion
A method of playing a content streaming over a communication network, the method comprising:
(I) storing a plurality of data chunks each having i (i> 1) different units for each of the indexed N periods, and index information for indexing N (N> 1) A first step of confirming a communication connection with a server managing a storage medium;
A second step of checking an index of a data chunk corresponding to an nth (n &gt; = 1) order of contents to be streamed out of data chunks stored in the storage medium; And
And a third step of requesting, by the server, data chunks corresponding to a unit to be streamed among the i units of data chunks matching the identified index, and processing the data chunks so as to be streamed.
Further comprising receiving information on contents to be streamed from the server and information on data chunks of the contents to be streamed.
Further comprising the step of identifying a unit capable of seamlessly streaming among the i different units to the terminal.
2. The apparatus of claim 1, wherein the i &lt;
Wherein the data stream includes a unit in which at least one of a frame rate, a data rate, and a capacity of data chunks are different from each other.
4. The method according to claim 1 or 3,
Wherein the data chunk requesting unit requests data chunks corresponding to a unit that can seamlessly be streamed to the terminal among the i units of data chunks matching the index, and processes the requested data chunks to be streamed.
Confirming the communication performance of the terminal; And
And determining a unit that can seamlessly be streamed to the terminal among i different units based on the communication performance of the terminal.
Further comprising the step of determining a request for data chunks matching the (n + 1) th order to be streamed next based on a reception capacity of data chunks streamed from the server.
Checking an index of a data chunk corresponding to the (n + 1) th order to be streamed next in the data chunks stored in the storage medium; And
And requesting, by the server, data chunks corresponding to a unit to be streamed among the i units of data chunks matching the identified index to be streamed.
And requesting, from the server, data chunks corresponding to a unit capable of streaming seamlessly among i units of data chunks matching the identified index, and processing the data chunks so as to be streamed.
The apparatus of claim 1, wherein the streaming-
And at least one of units determined based on a unit set in the terminal and a communication performance of the terminal.
KR1020140035629A 2014-03-26 2014-03-26 Method for Adaptive Streaming KR101499194B1 (en)
KR1020140035629A KR101499194B1 (en) 2014-03-26 2014-03-26 Method for Adaptive Streaming
KR20140048917A KR20140048917A (en) 2014-04-24
KR101499194B1 true KR101499194B1 (en) 2015-03-17
ID=50654763
KR (1) KR101499194B1 (en)
KR20160099959A (en) 2015-02-13 2016-08-23 에스케이텔레콤 주식회사 Computer readable recording medium recorded program and apparatus for providing low delay real-time content
KR20060050381A (en) * 2004-09-03 2006-05-19 마이크로소프트 코포레이션 A system and method for distributed streaming of scalable media
2014-03-26 KR KR1020140035629A patent/KR101499194B1/en active IP Right Grant
KR20140048917A (en) 2014-04-24
CN1254952C (en) 2006-05-03 Highly efficient transmission and playback of digital information
JP2009529826A (en) 2009-08-20 Video browsing of thumbnail image-based
WO2006033279A1 (en) 2006-03-30 Data processing device
US8483053B2 (en) 2013-07-09 Information processing device, information processing method, program, and data structure
US8345122B2 (en) 2013-01-01 Image playback method, music processing method, image playback apparatus, and computer program product
EP2091207B1 (en) 2014-12-17 Adaptive multimedia system for providing multimedia contents and codec to user terminal and method thereof
US9338523B2 (en) 2016-05-10 Audio splitting with codec-enforced frame sizes
CN1761310A (en) 2006-04-19 Coding system, coding method and coding apparatus
US8756334B2 (en) 2014-06-17 Moving image reproducing apparatus and method
JP2003284037A (en) 2003-10-03 Multimedia data reception device and method therefor, and multimedia data transmission device and method therefor
CN1972437A (en) 2007-05-30 Method and apparatus for data processing
CN101198045B (en) 2012-07-25 Stream media digital watermarking system
JP5088550B2 (en) 2012-12-05 Electronic device, reproduction method and program
2014-03-26 A107 Divisional application of patent
2014-03-26 A201 Request for examination
2015-02-27 GRNT Written decision to grant