Source: https://patents.google.com/patent/CN105612753A/en
Timestamp: 2019-01-17 12:18:33
Document Index: 454882185

Matched Legal Cases: ['art 10', 'art 10', 'art-12', 'art-12', 'art 10', 'art 10']

CN105612753A - Switching between adaptation sets during media streaming - Google Patents
Switching between adaptation sets during media streaming Download PDF
CN105612753A
CN105612753A CN 201480055085 CN201480055085A CN105612753A CN 105612753 A CN105612753 A CN 105612753A CN 201480055085 CN201480055085 CN 201480055085 CN 201480055085 A CN201480055085 A CN 201480055085A CN 105612753 A CN105612753 A CN 105612753A
CN 201480055085
CN105612753B (en )
A·S·克里希纳
L·C·明德
D·普特查拉
A device for retrieving media data includes one or more processors configured to retrieve media data from a first adaptation set including media data of a first type, present media data from the first adaptation set, in response to a request to switch to a second adaptation set including media data of the first type: retrieve media data from the second adaptation set including a switch point of the second adaptation set, and present media data from the second adaptation set after an actual playout time has met or exceeded a playout time for the switch point.
媒体流传输期间在适配集合间的切换 Adapted to switch between the set of streaming media during
[0001 ]本公开内容涉及对经编码的多媒体数据的存储和传输。 [0001] The present disclosure relates to the storage and transmission of multimedia data coded.
[0002]可以将数字视频能力并入到范围广泛的设备中，所述设备包括数字电视、数字直接广播系统、无线广播系统、个人数字助理(PDA)、膝上型或者台式计算机、数字照相机、数字记录设备、数字媒体播放器、视频游戏设备、视频游戏控制器、蜂窝或者卫星无线电话、视频远程会议设备等。 [0002] Digital video capabilities can be incorporated into a wide range of devices, said apparatus including digital televisions, digital direct broadcast systems, wireless broadcast systems, personal digital assistants (PDA), a laptop or desktop computers, digital cameras, digital recording device, a digital media player, video gaming devices, video game controllers, cellular or satellite radio telephones, video teleconferencing equipment. 数字视频设备实现诸如那些由MPEG-2、MPEG-4、ITU-T H.263或者ITU-TH.264/MPEG-4、Part 10、高级视频编码(AVC)所定义的标准以及这样的标准的扩展中所描述的视频压缩技术，以更加高效地发送和接收数字视频信息。 Digital video devices such as those implemented by the MPEG-2 MPEG-4, ITU-T H.263 or ITU-TH.264 / MPEG-4, Part 10, Advanced Video Coding (AVC) standards as defined by such standards as well, the extensions of video compression techniques to more efficiently transmit and receive digital video information.
[0003]在视频数据已经被编码后，可以将视频数据分组化，以用于传输或者存储。 [0003] After the video data has been encoded, the video data may be packetized, for transmission or storage. 可以将视频数据组装成符合各种标准(例如，国际标准化组织基础媒体文件格式及其扩展，例如，MP4文件格式和高级视频编码(AVC)文件格式)中的任何标准的视频文件。 Video data can be assembled into compliance with various standards (eg, ISO base media file format and extensions, for example, MP4 file format, and Advanced Video Coding (AVC) file format) to any standard video file. 可以以各种方式来传输这样的分组化视频数据，例如，通过使用网络流的计算机网络进行传输。 It may be various ways such packets are transmitted video data, for example, transmitted over a computer network using network flow.
[0004]总体上，本公开内容描述了关于在媒体数据的流传输(例如，通过网络)期间的在适配集合之间的切换。 [0004] In general, the present disclosure is described with respect to the streaming media data (e.g., via a network) adapted to switch between a set period. 总体上，适配集合可以包括特定类型的媒体数据，例如，视频、音频、定时文本等。 Overall, the adapter may include a particular set of types of media data, e.g., video, audio, timed text, etc. 尽管常规上，在通过网络的媒体流传输中，已经提供了用于在适配集合内的表示之间切换的技术，但是总体上，本公开内容的技术针对在适配集合本身之间切换的技术。 Although conventionally, the media streaming through the network, technology has been provided for switching between representations in the adaptation set, but in general, the techniques of this disclosure are adapted for the collection itself handover between technology.
[0005]在一个示例中，取回媒体数据的方法包括，从包括第一类型的媒体数据的第一适配集合取回媒体数据，呈现来自第一适配集合的媒体数据，响应于切换到包括第一类型的媒体数据的第二适配集合的请求:从第二适配集合取回包括第二适配集合的切换点的媒体数据，以及在实际播出时间已经满足或超过切换点的播出时间之后呈现来自第二适配集合的媒体数据。 [0005] In one example, the method comprises retrieving media data, retrieving a first type of media data comprising a first set of adaptation data from the media, the media presentation data from the first set is adapted, in response to the switching to a first type of media data comprising a second set of adaptation request: retrieving from the second set of media data adaptation includes a second switching point is adapted to set, and the actual broadcast time has been met or exceeded the switching point presenting media data from the second set of adaptation after the broadcast time.
[0006]在另一个示例中，用于取回媒体数据的设备包括一个或多个处理器，其被配置为从包括第一类型的媒体数据的第一适配集合取回媒体数据，呈现来自第一适配集合的媒体数据，响应于切换到包括第一类型的媒体数据的第二适配集合的请求:从第二适配集合取回包括第二适配集合的切换点的媒体数据，以及在实际播出时间已经满足或者超过切换点的播出时间之后呈现来自第二适配集合的媒体数据。 [0006] In another example, an apparatus for retrieving media data includes one or more processors that are configured to retrieve a first type of media data includes media data from a first set of adaptation, from a presentation a first set of media data adaptation in response to a request to switch to the second fitting comprises a first set of media data types of: retrieving from the second set of media data adaptation includes a second set of adaptation of the switching point, and presenting the media from the second data set after fitting the actual broadcast time has been met or exceeded the switching point of the broadcast time.
[0007]在另一个示例中，用于取回媒体数据的设备包括:用于从包括第一类型的媒体数据的第一适配集合取回媒体数据的单元，用于呈现来自第一适配集合的媒体数据的单元，用于响应于切换到包括第一类型的媒体数据的第二适配集合的请求，从第二适配集合取回包括第二适配集合的切换点的媒体数据的单元，以及响应于请求而在实际播出时间已经满足或者超过切换点的播出时间之后呈现来自第二适配集合的媒体数据的单元。 [0007] In another example, an apparatus for retrieving media data comprises: means for retrieving media data comprises a first type of media data from a first set of adaptation, from a first adapted for rendering media data collection unit, in response to a request to switch to the second fitting comprises a first set of media data type, the second adapter comprises retrieving media data set from a second set of adaptation of the switching point unit, and a presentation unit from the second set of media data adaptation after the response to the request has been met or exceeded the actual broadcast time of the broadcast time of the switching point.
[0008]在另一个示例中，计算机可读存储介质具有存储于其上的指令，当所述指令被执行时使处理器:从包括第一类型的媒体数据的第一适配集合取回媒体数据，呈现来自第一适配集合的媒体数据，响应于切换到包括第一类型的媒体数据的第二适配集合的请求:从第二适配集合取回包括第二适配集合的切换点的媒体数据，以及在实际播出时间已经满足或者超过切换点的播出时间之后呈现来自第二适配集合的媒体数据。 [0008] In another example, a computer-readable storage medium having instructions stored thereon, so that the processor when the instruction is executed: a first type of media data comprising a first set adapted to retrieve from the medium data, presenting the media from the first data set is adapted, in response to a request to switch to the second fitting comprises a first set of media data types: retrieving from a second set of adapter comprising a second adapter set of switch points media data, and the actual broadcast time has been met or present the media data from the second set of adaptation exceeds the switching point after the broadcast time.
[0009]在以下的附图和描述中阐述了一个或多个示例的细节。 [0009] illustrates one or more examples in the following drawings and description. 根据描述和附图，并且根据权利要求书，其它的特征、目标和优点将是显而易见的。 The description and drawings, and from the claims, other features, objects, and advantages will be apparent.
[0010]图1是示出了实现用于通过网络来流传输媒体数据的技术的示例系统的框图。 [0010] FIG. 1 is a block diagram illustrating a technique to implement the streaming media data over a network in an example system.
[0011]图2是示出了示例多媒体内容的要素的概念图。 [0011] FIG. 2 is a conceptual diagram illustrating an example of multimedia content elements.
[0012]图3是示出了示例视频文件的要素的框图，所述示例视频文件可以对应于多媒体内容的表示的片段。 [0012] FIG. 3 is a block diagram showing elements of an example of a video file, the video file showing exemplary segment may correspond to a multimedia content.
[0013]图4A和图4B是示出了根据本公开内容的技术的、用于在播放期间在适配集合之间进行切换的示例方法的流程图。 [0013] FIGS 4A and 4B are a flowchart illustrating an example method for switching between a set of adaptation in accordance with the techniques of this disclosure during the playing.
[0014]图5是示出了根据本公开内容的技术的、用于在适配集合之间进行切换的另一个示例方法的流程图。 [0014] FIG. 5 is a flowchart illustrating another example method for switching between a set of adaptation in accordance with the techniques of this disclosure.
[0015]总体上，本公开内容描述了涉及通过网络对多媒体数据(例如，音频和视频数据)进行流传输的技术。 [0015] In general, the present disclosure describes relates to the streaming of multimedia data (e.g., audio and video data) over a network technology. 可以结合通过HTTP的动态自适应流传输(DASH)来使用本公开内容的技术。 Bonding techniques can be used in the present disclosure Dynamic Adaptive Streaming over HTTP (the DASH) through. 本公开内容描述了可以结合网络流传输来执行的各种技术，可以单独或者以任何组合来实现所述技术中的任何或者全部技术。 The present disclosure describes various techniques may be combined to perform the streaming network, may be used alone or in any combination of any or all of the techniques in the art. 如在下文中更加详细地描述的，执行网络流传输的各种设备可以被配置为实现本公开内容的技术。 As described in more detail hereinafter, the network performs streaming various devices may be configured to implement the techniques of the present disclosure.
[0016]根据DASH和用于通过网络来流传输数据的类似技术，可以以各种方式并且利用各种特性来将多媒体内容(例如，电影或者也可以包括音频数据、视频数据、文本覆盖或者其它数据的其它媒体内容，其统一被称为“媒体数据”)编码。 [0016] According to DASH and similar techniques for streaming data through the network, and may be in a variety of ways using a variety of features to the multimedia content (e.g., movie or may include audio data, video data, text overlay, or other other media content data, the uniform is referred to as "media data") coding. 内容准备设备可以形成相同的多媒体内容的多个表示。 A plurality of content preparation device may be formed of the same multimedia content representation. 每个表示可以对应于特性的特定集合(例如，编码和渲染特性)，以提供可由具有各种编码和渲染能力的多种不同的客户端设备使用的数据。 Each representing a particular set may correspond to a characteristic (e.g., encode and rendering characteristic) to provide data of a plurality of different client devices may be used with various coding and rendering capabilities. 此外，具有各种比特速率的表示可以允许带宽适配。 In addition, various bit rate represents a bandwidth adaptation may allow. 也就是说，客户端设备可以确定当前可用的带宽的量，并且基于可用的带宽的量来选择表示，以及客户端设备的编码和渲染能力。 That is, the client device may determine the amount of bandwidth currently available, based on the amount of available bandwidth and to select said encoding and rendering capabilities of the client device.
[0017]在一些示例中，内容准备设备可以指示表示的集合具有公共特性的集合。 [0017] In some examples, the device may indicate a set of content preparation having a set of common features represented. 然后，内容准备设备可以指示集合中的表示形成适配集合，以使得集合中的表示可以被用于带宽适配。 Then, content preparation device may indicate the set form represents the adaptation set, so that the set may be represented for bandwidth adaptation. 也就是说，适配集合中的表示可以在比特速率方面彼此不同，但是在其它方面共享大体上相同的特性(例如，编码和渲染特性)。 That is, the adaptation set represents the bit rate different from each other respect, sharing substantially the same characteristics (e.g., encoding and rendering characteristic) in other ways. 以这种方式，客户端设备可以针对多媒体内容的各种适配集合来确定公共的特性，并且基于客户端设备的编码和渲染能力来选择适配集合。 In this manner, the client device may determine a common set of characteristics adapted for a variety of multimedia contents, and based on the coding and rendering capabilities of the client device is adapted to select a set. 然后，客户端设备可以基于带宽可用性在所选择的适配集合中在表示之间自适应地切换。 Then, the client device may be adapted based on bandwidth availability in the selected set of adaptively switching between representations.
[0018]在一些情况下，可以针对特定类型的所包括的内容来构造适配集合。 [0018] In some cases, the adapter may be configured for collection of a particular type of content included. 例如，可以形成用于视频数据的适配集合，以使得针对场景的每个照相机角度(或者照相机视角)存在至少一个适配集合。 For example, a form adapted for the video data set, so that the angle of each camera (or camera angle of view) of the scene for at least a set of adaptation. 作为另一个示例，可以针对不同的语言提供用于音频数据和/或定时文本(例如，字幕文本数据)的适配集合。 As another example, the audio data may be provided for adapting and / or timed text (e.g., text caption data) for a set of different languages. 也就是说，可以存在针对每个期望的语言的音频适配集合和/或定时文本适配集合。 In other words, there may be a set of desired audio adapter for each set of language and / or timed text adaptation. 这可以允许客户端设备基于用户偏好(例如，针对音频和/或视频的语言偏好)来选择合适的适配集合。 This may allow the client device based on user preferences (e.g., for audio and / or video language preference) is adapted to select the appropriate set. 作为另一个示例，客户端设备可以基于用户偏好来选择一个或多个相机角度。 As another example, the client device may be based on user preferences to select one or more camera angles. 例如，用户可能希望观看特定的场景的替代的相机角度。 For example, a user may wish to view a particular scene of alternative camera angles. 作为另一个示例，用户可能希望在三维(3D)视频中观看相对更多或更少的深度，在这种情况下，用户可以选择具有相对较近或者距离较远的照相机视角的两个或更多个视图。 As another example, the user may wish to view more or less relative to the depth of three-dimensional (3D) video, in which case, the user may select two or have a relatively close distance from the camera angle of view farther or less multiple views.
[0019]可以将用于表示的数据分成个体的文件，通常被称为片段。 [0019] can be used for data representation into individual documents, commonly referred to as segments. 文件中的每个文件都是由特定的统一资源定位符(URL)可寻址的。 Each file in the file is a specific uniform resource locator (URL) addressable. 客户端设备可以在特定的URL处提交针对文件的GET请求以取回文件。 The client device can be submitted for a particular file in the URL of the GET request to retrieve the file. 根据本公开内容的技术，客户端设备可以通过例如根据由对应的服务器设备提供的URL模板将期望的字节范围包括在URL通道本身内来修改GET请求。 According, the client device of the present disclosure may include, for example, a GET request to modify the channel itself within the URL based on the URL corresponding to the template provided by the server device by a desired byte range.
[0020 ]视频文件(例如，媒体内容的表示的片段)可以符合根据ISO基础媒体文件格式、可缩放编码(SVC)文件格式、高级视频编码(AVC)文件格式、第三代合作伙伴计划(3GPP)文件格式和/或多视角视频编码(MVC)文件格式或者其它相似的视频文件格式中的任何项来封装的视频数据。 [0020] video files (for example, segments of the media content representation) may be in accordance with ISO base media file format, Scalable Coding (SVC) file format, Advanced Video Coding (AVC) file format, Third Generation Partnership Project (3GPP ) video data file formats and / or multi-view video coding (MVC) file format, or other similar video file formats to package any item.
[0021 ] ISO基础媒体文件格式被设计为包含定时的媒体信息，以用于以促进媒体的互换、管理、编辑和呈现的灵活的、可扩展的格式来呈现。 [0021] ISO base media file format is designed to contain timed media information for the media to facilitate interchange, management, editing, and presentation of a flexible, extensible format presented. 在MPEG-4Part-l 2中指定了ISO基础媒体文件格式(IS0/IEC 14496-12:2004)，所述MPEG-4Part-12定义了基于时间的媒体文件的一般结构。 Specifies the ISO base media file format (IS0 / IEC 14496-12: 2004) in MPEG-4Part-l 2, the MPEG-4Part-12 defines the general structure of time-based media file. ISO基础媒体文件格式被用作家族中的其它文件格式(例如，被定义为支持H.264/MPEG-4AVC视频压缩的AVC文件格式(IS0/IEC 14496-15)、3GPP文件格式、SVC文件格式、以及MVC文件格式)的基础。 ISO base media file format is a file format used for other family (e.g., is defined to support the MPEG-4 AVC video compression the H.264 AVC file format of / (IS0 / IEC 14496-15), 3GPP file format, the SVC file format and MVC file format) basis. 3GPP文件格式和MVC文件格式是AVC文件格式的扩展。 3GPP file format and MVC file format is an extension of the AVC file format. ISO基础媒体文件格式包括时序(timing)、结构以及针对媒体数据的定时序列(例如，视听呈现)的媒体信息。 ISO base media file format includes a timing (Timing), the structure and timing sequence (e.g., audio-visual presentation) media information for the media data. 文件结构可以是面向对象的。 File structure can be object-oriented. 文件可以简单地被分解成基本对象和可以从其类型中暗示的对象结构。 File can be decomposed into simple and basic object types it can be implied from an object structure.
[0022]符合ISO基础媒体文件格式(及其扩展)的文件可以被形成为一系列的对象，称为“盒子”。 [0022] file conforms to the ISO base media file format (and extensions thereof) may be formed as a series of objects, called a "box." 可以将ISO基础媒体文件格式中的数据包括在盒子中，以使得在文件内不需要包括其它数据，并且在文件内不需要存在盒子以外的数据。 ISO base media file format data can be included in the box, so that no other data including in the file, and data other than the box need not be present in the paper. 这包括特定文件格式所需要的任何初始签名。 This includes any initial signature file format specific needs. “盒子”可以是由唯一类型的标识符和长度定义的面向对象的构件块。 "Box" may be an object-oriented building block by a unique type identifier and a defined length. 通常，呈现被包括在一个文件中，并且媒体呈现是独立的。 In general, the presentation is included in a file and media presentation are independent. 电影容器(电影盒子)可以包括媒体的元数据以及可以被包括在媒体数据容器中并且可以在其它文件中的视频和音频帧。 Film containers (film cassette) may include metadata and media may be included and may be video and audio frames in the media data container in the other files.
[0023]可以将表示(运动序列)包括在若干个文件(有时被称为片段)中。 [0023] may be expressed (motion sequence) comprises a plurality of files (sometimes referred to as a segment) is. 定时和分帧(位置和大小)信息通常在ISO基础媒体文件中，并且辅助文件基本上可以使用任何格式。 Timing and framing (position and size) information is generally in the ISO base media file, the auxiliary file and may be substantially any format. 该呈现可以“本地”于包括呈现的系统，或者可以经由网络或者其它流传递机制而被提供。 The presentation may be "local" in the present system include, or may be via a network or other stream delivery mechanism is provided.
[0024]当通过流传输协议来传递媒体时，可能需要将媒体从其在文件中所表示的方式中变形。 [0024] When a media to pass through the streaming protocol may need to be deformed from a media file in the embodiment represented by. 这种情况的一个示例是当通过实时传输协议(RTP)来发送媒体时。 An example of this is when the media is transmitted by a real-time transport protocol (RTP). 例如，在文件中，视频的每个帧都被连续地存储为文件格式样本。 For example, in a file for each frame of video are successively stored as a sample file format. 在RTP中，必须服从特定于所使用的编解码器的分组化规则，以将这些帧置于RTP分组中。 In RTP, the packet must obey the rules specific to the codec used to place the frames in the RTP packets. 流传输服务器可以被配置为实时地计算这样的分组化。 The streaming server may be configured to calculate in real time of packets such. 然而，存在针对对流传输服务器的帮助的支持。 However, there is support for helping the streaming server.
[0025]本公开内容描述了用于在经由流传输(例如，利用DASH的技术)取回的媒体数据的播放(还称为播出)期间在适配集合之间进行切换的技术。 [0025] The present disclosure describes a technique for switching between a set during fitting via streaming (e.g., using the techniques DASH) playing the retrieved media data (also referred to as broadcast). 例如，在流传输期间，用户可能希望切换音频和/或字幕的语言，查看替代的照相机角度、或者增加或降低3D视频数据的深度的相对量。 For example, during the streaming, the user may wish to switch the audio and / or subtitle language alternative camera angle to view, or to increase or decrease the amount of relative depth of the 3D video data. 为了适应用户，客户端设备可以在已经从第一适配集合取回了一定量的媒体数据之后，切换到包括与第一适配集合相同类型的媒体数据的第二、不同的适配集合。 In order to adapt to the user after the client device may have a collection of a certain amount of retrieved data from the first medium adapted to switch comprising a set of a second, different set of adaptation of the first adaptation of the same type of media data. 客户端设备可以继续播出从第一适配集合取回的媒体数据，至少直到已经将第二适配集合的切换点译码之后为止。 The client device may continue to broadcast the retrieved set of data from a first media adaptation, at least until after the switching point so far has been adapted to decode the second set. 例如，针对视频数据，切换点可以对应于瞬时译码器刷新(IDR)图片、干净随机访问(CRA)图片、或者其它随机访问点(RAP)图片。 For example, for video data, a switching point may correspond to an instantaneous decoder refresh (IDR) picture, a clean random access (CRA) images, or other random access point (RAP) picture.
[0026]应当理解的是，本公开内容的技术特别地针对适配集合之间的切换，并且不仅是适配集合内的表示。 [0026] It should be appreciated that the techniques of this disclosure are particularly adapted for switching between the set and not only is the adaptation set. 鉴于先前技术允许客户端设备在公共适配集合的表示间进行切换，本公开内容的技术针对在适配集合本身间的切换。 In view of the prior art allow the client device to switch between denotes a common set of adaptation, the techniques of this disclosure is adapted to switch between set for itself. 如在下文中所描述的，该适配集合切换允许用户享受例如归因于不中断的播放体验的更愉快的体验。 As described below, the set switch adapted to allow the user to enjoy, for example, due to the uninterrupted playback experience more enjoyable experience. 常规上，如果用户想要切换到不同的适配集合，媒体数据的播放将需要被中断，这导致不愉快的用户体验。 Conventionally, if a user wants to switch to a different set of adaptation, playing the media data it will need to be interrupted, which leads to an unpleasant user experience. 也就是说，用户将需要完全停止播放，选择不同的适配集合(例如，相机角度和/或音频或者定时文本的语言)，接着从媒体内容的开始处重新开始播放。 That is, the user will need to completely stop playing, select a different set of adaptation (e.g., camera angle and / or an audio language or timed text), then starts playback from the beginning of the media content. 为了回到之前的播放位置(即，当媒体播放被中断以便切换适配集合时的播放位置)，用户将需要进入技巧模式(例如，快进)并且手动地找到之前的播放位置。 To return to the playback position before (i.e., is interrupted when the media player to play the switching position of adaptation set), the user will need to enter a trick mode (e.g., fast forward) and manually locate the playback position before.
[0027]此外，中断媒体数据的播放导致丢弃之前取回的媒体数据。 [0027] In addition, the interrupt cause data media playing the media data retrieved before disposal. 也就是说，为了执行流传输媒体取回，客户端设备通常在当前的播放位置之前就缓冲好媒体数据。 That is, in order to perform the streaming media retrieval, the client device buffer is usually a good media data before the current playback position. 以这种方式，如果(例如，响应于带宽波动)需要发生适配集合的表示之间的切换，存在存储在缓冲器中的足够的媒体数据，以允许在不中断播放的情况下发生切换。 In this manner, switching between the represented set if adaptation (e.g., in response to fluctuations in bandwidth) need to occur, there is sufficient media data stored in the buffer to allow the handover occurs without interrupting playback. 然而，在上文所描述的场景中，经缓冲的媒体数据将完全被浪费。 However, in the scenario described above, buffered media data will be completely wasted. 特别地，不仅仅将放弃当前的适配集合的经缓冲的媒体数据，而且还将放弃没有被切换的其它适配集合的经缓冲的媒体数据。 In particular, not only will abandon the current buffered media data adaptation set, but also give up buffered media data is not adapted to other set of switches. 例如，如果用户想要从英语语言音频切换到西班牙语语言音频，播放将中断，并且英语语言和对应的视频数据两者都将被放弃。 For example, if a user wants to switch from English to Spanish language audio language audio, playback will be interrupted, and both the English language and the corresponding video data will be discarded. 接着，在切换到西班牙语语言的音频适配集合之后，客户端设备将再次取回先前被放弃的该视频数据。 Subsequently, after switching to the Spanish language audio adaptation set, the client device will retrieve the video data previously abandoned again.
[0028]另一方面，本公开内容的技术允许，例如，在不中断播放的情况下，在媒体流传输期间在适配集合之间进行切换。 [0028] On the other hand, technology allows the present disclosure, for example, without interrupting playback of streaming media during switching between the adaptation set. 例如，客户端设备可能已经从第一适配集合取回了媒体数据(并且更加具体而言，第一适配集合的表示)，并且可能正在呈现来自第一适配集合的媒体数据。 For example, the client device may have been retrieved from the first set of media data adaptation (and, more specifically, represents a first set of adaptation), and may render the media data is being adapted from the first set. 在呈现来自第一适配集合的媒体数据时，客户端设备可以接收请求以切换到第二、不同的适配集合。 When presenting media data from the first set of adaptation, the client device may receive a request to switch to a second, different set of adaptation. 请求可以源自响应于来自用户的输入而由客户端设备执行的应用。 Request may originate from the application responsive to input from a user and executed by the client device.
[0029]例如，用户可能希望切换到不同语言的音频，在这种情况下用户可以提交请求以改变音频语言。 [0029] For example, a user may wish to switch to a different audio languages, in which case the user may submit a request to change the audio language. 作为另一个示例，用户可能希望切换到不同语言的定时文本(例如，字幕)。 As another example, a user may wish to switch to a different language of timed text (e.g., caption). 作为又一个示例，用户可能希望切换照相机角度，在这种情况下用户可以提交改变相机角度(并且每个适配集合可以对应于特定的照相机角度)的请求。 As yet another example, the user may wish to switch the angle of the camera, in which case the user may submit a change camera angle (and each adaptation set may correspond to a particular camera angle) request. 切换照相机角度可以简单地用于从不同的视角看视频，或者用于改变第二(或其他额外的)观看角度，例如，以用于增加或者降低在3D播放期间所显示的相对深度。 The camera angle can be switched easily to watch video from a different perspective, or for changing the second (or additional to) viewing angle, e.g., for increasing or decreasing the relative depth during 3D playback displayed.
[0030]响应于请求，客户端设备可以从第二适配集合取回媒体数据。 [0030] In response to the request, the client device may retrieve media data set from the second adapter. 特别地，客户端设备可以从来自第二适配集合的表示取回媒体数据。 In particular, from the client device may represent a second set adapted to retrieve media data. 所取回的媒体数据可以包括切换点(例如，随机访问点)。 The retrieved media data may include switching points (e.g., random access point). 客户端设备可以继续呈现来自第一适配集合的媒体数据，直到实际的播出时间已经满足或者超过针对第二适配集合的切换点的播出时间。 The client device may continue to present media data from a first set of adaptation, until the actual broadcast time has been met or exceeded for a broadcast time of the switching point of the second set of adaptation. 通过这样方式，客户端设备可以利用第一适配集合的经缓冲的媒体数据，并且避免在从第一适配集合切换到第二适配集合期间中断播出。 By this way, the client device may utilize a first buffered media data adaptation set, and avoid switching from the first set is adapted to broadcast an interrupt during a second set of adaptation. 换句话说，在实际的播出时间已经满足或者超过第二适配集合的切换点的播出时间之后，客户端设备可以开始呈现来自第二适配集合的媒体数据。 Other words, after the actual broadcast time of the broadcast time has been met or exceeded the second set of adaptation of the switching point, the client device can start rendering the media data from the second set of adaptation.
[0031]当在适配集合之间进行切换时，客户端设备可以确定第二适配集合的切换点的位置。 [0031] When switching between the adapter set, the client device may be adapted to determine the position of a second set of switch points. 例如，客户端设备可以参考限定了第二适配集合中的切换点的位置的清单文件，例如，媒体呈现描述(MPD)。 For example, with reference to client device may define a list of file locations of the second switching point is adapted to set, for example, Media Presentation Description (MPD). 通常，公共适配集合的表示是在时间上对齐的，以使得公共适配集合的表示中的每个表示中的片段边界发生在相同的播放时间处。 Typically, denotes a common set of adaptation is aligned in time, so that the boundary segment adapted denotes a common set of each representation occurs at the same time playing. 然而，不同的适配集合不是所说的这样。 However, a different set of adaptation is not said so. 也就是说，尽管公共适配集合的表示的片段可以是在时间上对齐的，但是不同的适配集合的表示的片段不需要在时间上对齐。 That is, although the segment represented by the common set may be adapted in time alignment, but different sets of fragments represented by adaptation need not be aligned in time. 因此，当从一个适配集合的表示切换到另一个适配集合的表示时确定切换点的位置可能是困难的。 Thus, when expressed from a set adapted to determine the switching point when switching to the position represented by another set of adaptation may be difficult.
[0032]因此，客户端设备可以参考清单文件以针对第一适配集合的表示(例如，当前的表示)以及第二适配集合的表示两者确定片段边界。 [0032] Thus, the client device may refer to both the representation and the manifest file to a second set adapted to determine a boundary for a first segment represents a set of adaptation (e.g., the current representation). 片段边界通常是指包括在片段内的媒体数据的开始和结束播放的时间。 Generally it refers segment boundaries including the beginning and end play in the media data time segment. 因为在不同的适配集合之间，片段不一定是在时间上对齐的，所以客户端设备可能需要取回在时间上交迭的两个片段的媒体数据，其中两个片段来自不同的适配集合的表示。 Because the adaptation between the different set of fragments is not necessarily aligned in time, so the client device retrieving the media data may require two fragments overlap in time, wherein different adapter fragments from two express collection.
[0033]客户端设备还可以尝试在第二适配集合中找到最接近于接收到切换到第二适配集合的请求的播放时间的切换点。 [0033] The client device may also try to find the closest point to the received handover request to switch to a second set of adaptation of the playing time in the second adaptation set. 通常，客户端设备尝试在第二适配集合中找到在播放时间方面比接收到切换到第二适配集合的请求的时间晚的切换点。 Typically, the client device adapted to try to find the second set in terms of time than the received playback request to switch to a second set of adaptation of the switching point of time later. 然而，在某些实例中，切换点可以出现在距离接收到在适配集合之前进行切换的请求的播放时间不可接受地远的位置;通常，这仅仅当将要被切换适配集合包括定时文本(例如，用于字幕)时。 However, in certain instances, from the switching point may be receiving the request to switch is set before the adaptation of the playing time unacceptably remote location occurs; usually, this is only when a switch adapted to be set includes timed text ( for example, subtitles). 在这样的实例中，客户端设备可以请求在播放时间中比接收到切换请求的时间早的切换点。 In such instances, the client device may request the playback time than the time of the handover request received earlier switching point.
[0034]本公开内容的技术可以适用于网络流传输协议，例如，根据通过HTTP的动态自适应流传输(DASH)的HTTP流传输。 [0034] The present technical disclosure may be applicable to a network streaming protocols, e.g., HTTP streaming according to the dynamic adaptive streaming HTTP (the DASH) through. 在HTTP流传输中，频繁使用的操作包括GET和部分GET AET操作取回与给定的统一资源定位符(URL)或者其它标识符(例如，URI)相关联的整个文件。 In HTTP streaming, the frequently used operations associated with the file including the entire portion GET and GET operation retrieves in AET given a uniform resource locator (URL) or other identifier (e.g., URI). 部分GET操作将字节范围作为输入参数来接收，并且取回对应于所接收的字节范围的连续数量的字节的文件。 Byte range GET operation section as an input parameter received, and retrieves the number of bytes corresponding to successive ranges of the received byte file. 因此，可以为电影片段提供HTTP传输，这是因为部分GET操作可以获得一个或多个个体的电影片段。 Thus, it is possible to provide for the movie fragments HTTP transport, because a partial GET operation may obtain one or more individual movie fragments. 注意，在电影片段中，可以存在不同的轨道的若干个轨道片段。 Note that, in the movie fragment, there may be several different tracks of track fragment. 在HTTP流传输中，媒体表示可以是可由客户端访问的数据的结构化集合。 In HTTP streaming, the media may be represented by the structure of the data access client set. 客户端可以请求并且下载媒体数据信息以向用户呈现流传输服务。 Client can request the media data and download information to present a streaming service to a user.
[0035]在使用HTTP流传输的流传输3GPP数据的示例中，可以存在多媒体内容的视频和/或音频数据的多个表示。 A plurality [0035] In the example of using HTTP streaming 3GPP streaming data, multimedia content may be present in a video and / or audio data represented. 可以在媒体呈现描述(MPD)数据结构中限定这样的表示的清单。 (MPD) data structures described may be presented in a media list is defined such representation. 媒体表示可以对应于可由HTTP流传输客户端设备访问的数据的结构化的集合。 Media representation may correspond to a set of structured data by HTTP streaming client device to access. HTTP流传输客户端设备可以请求和下载媒体数据信息以向客户端设备的用户呈现流传输服务。 HTTP streaming client device may request and download media data to the user information to the client device rendering streaming service. 可以以可以包括MPD的更新的MI3D数据结构来描述媒体表示。 MI3D may include updating the data structure may be described in the MPD media representation.
[0036]每个时段可以包含相同的媒体内容的一个或多个表示。 [0036] Each time the same media content may comprise one or more representations. 表示可以是音频或者视频数据的多个替代的经编码的版本中的一个版本。 Representation may be a plurality of alternate version of the encoded audio or video data is. 可以通过各种特性(例如编码类型)来使表示相异，例如，针对视频数据通过比特速率、分辨率、和/或编解码器，并且针对音频数据通过比特速率、语言、和/或编解码器。 Can be enabled by different represent various characteristics (e.g., coding type), for example, for video data bit rate, resolution, and / or codec, bit rate and by, language, and / or data for the audio codec device. 术语表示可以用来指对应于多媒体内容的特定的时段并且以特定的方式被编码的经编码的音频或视频数据的部分。 The term may be used to refer to a specific indicates a period corresponding to the multimedia content and partially encoded in a specific manner the encoded audio or video data.
[0037]特定的时段的表示可以被分配给组，所述组可以由MPD中的group(组)属性来指示。 Represents a [0037] specific period may be assigned to a group, the group may be indicated by the MPD Group (group) attributes. 相同的组中的表示通常被认为可以相互代替。 It represents the same group is generally considered to be replaced by each other. 例如，可以将特定的时段的视频数据的每个表示分配给相同的组，以使得可以选择表示中的任何表示以进行译码，以显示对应的阶段的多媒体内容的视频数据。 For example, each may represent the same group is assigned to a specific period of video data, so that the representation of any representation can be selected to be decoded to display the video data corresponding to the multimedia content stage. 在一些示例中，一个时段内的媒体内容可以或者由来自组O的一个表示(如果存在的话)或者由来自每个非零组的最多一个表示来表示。 In some examples, a media content within a period of time or may be from a group represented by O (if present) or to represent every nonzero up from a group represented by the. 可以相对于时段的开始时间来表达针对时段中的每个表示的时序数据。 Relative to the start period can be expressed for periods of time series data for each representation.
[0038]表示可以包括一个或多个片段。 [0038] The representation may include one or more segments. 每个表示可以包括初始化片段，或者表示的每个片段可以是自行初始化的。 Each representation may include initialization fragment, or each segment may be represented by their own initialization. 当存在时，初始化片段可以包括初始化信息以用于对表示进行访问。 When present, the initialization fragment may include initialization information for indicating access. 通常，初始化片段不包括媒体数据。 Typically, the media data does not include the initialization fragment. 片段可以唯一地通过标识符(例如，统一资源定位符)来引用Jro可以针对每个片段来提供标识符。 Fragments may be uniquely referenced by Jro identifier (e.g., Uniform Resource Locator) identifier may be provided for each segment. 在一些示例中，Mro还可以以range (范围)属性的形式提供字节范围，其可以对应于可以通过URL或者URI访问的文件内的片段的数据。 In some examples, Mro byte range may also be provided in the form of range (range) attributes, which may correspond to data segments within a file can be accessed by a URL or URI.
[0039]每个表示还可以包括一个或多个媒体分量，其中，每个媒体分量可以对应于一个个体的媒体类型(例如，音频、视频、和/或定时文本(例如，隐藏字幕))的经编码的版本。 [0039] Each representation may also include one or more media components, wherein each media component may correspond to an individual media type (e.g., audio, video, and / or timed text (e.g., closed captioning)) of encoded version. 媒体分量可以是跨越一个表示内的连续的媒体片段的边界而时间连续的。 Media component may be continuous across the boundary of the media segments within a time-continuous representation. 因此，表示可以对应于个体的文件或者片段的序列，其中每项都可以包括相同的编码和渲染特性。 Thus, the representation may correspond to a sequence or a fragment of an individual document, where each may include the same coding and rendering characteristic.
[0040]在一些示例中，本公开内容的技术可以提供一个或多个益处。 [0040] In some examples, the techniques of this disclosure may provide one or more benefits. 例如，本公开内容的技术允许在适配集合之间进行切换，这可以允许用户在进行过程中在相同类型的媒体之间进行切换。 For example, the techniques of this disclosure allow switching between the adapter set, which may allow the user during the process of switching between the same type of media. 也就是说，用户可以请求在媒体的类型(例如，音频、定时文本或者视频)的适配集合之间进行切换，并且客户端设备可以无缝地执行切换，而不是停止播放以在适配集合之间改变。 That is, the user may request the type of media (e.g., audio, timed text or videos) adapted to switch between the set and the client device can perform a handover seamlessly, rather than the adapter set to stop playing changes in between. 这可以避免浪费经缓冲的媒体数据，同时还避免播放期间的间隙或者暂停。 This avoids wasting buffered media data, while also avoiding gaps or pause during playback. 因此，本公开内容的技术可以提供更加令人满意的用户体验，同时也避免过多的网络带宽消耗。 Therefore, the technology of the present disclosure may provide a more satisfying user experience, but also to avoid excessive network bandwidth consumption.
[0041]图1是示出了实现用于通过网络来流传输媒体数据的技术的示例系统10的框图。 [0041] FIG. 1 is a block diagram illustrating a technique to implement the streaming media data over a network system 10 is exemplary. 在该示例中，系统10包括内容准备设备20、服务器设备60和客户端设备40。 In this example, the system 10 includes a 20, server device 60 and client device 40 the content preparation device. 客户端设备40和服务器设备60通过可以包括互联网的网络74通信地耦合。 Client device 40 and server device 60 via network 74 may include a coupling communication via the Internet. 在一些示例中，内容准备设备20和服务器设备60还可以通过网络74或者另一个网络相耦合，或者可以直接通信地耦合。 In some examples, the content preparation device 20 and server device 60 may also be coupled to the network 74 or another network, or may be directly communicatively coupled. 在一些示例中，内容准备设备20和服务器设备60可以包括相同的设备。 In some examples, the content preparation device 20 and server device 60 may comprise the same device. 在一些示例中，内容准备设备20可以将所准备的内容分布至包括服务器设备60的多个服务器设备。 In some examples, the content preparation device 20 may be distributed into the prepared content server device comprises a plurality of server device 60. 相似地，在一些示例中，客户端设备40可以与包括服务器设备60在内的多个服务器设备进行通信。 Similarly, in some examples, client device 40 may communicate with the server device comprises a plurality of server devices 60, including.
[0042]如在下文中更加详细地描述的，客户端设备40可以被配置为执行本公开内容的某些技术。 [0042] As described in more detail below, the client device 40 may be configured to perform some of the techniques of the present disclosure. 例如，客户端设备40可以被配置为在媒体数据的播放期间在适配集合之间进行切换。 For example, the client device 40 may be configured to switch between the set of adaptation during playback of the media data. 客户端设备40可以提供用户界面，通过所述用户界面，用户可以提交请求以在特定类型的媒体(例如，音频、视频和/或定时文本)的适配集合之间进行切换。 The client device 40 may provide a user interface, the interface, the user can submit a request to a specific set of adaptation between the type of media (e.g., audio, video, and / or timed text) is switched by the user. 以这种方式，客户端设备40可以接收请求以在相同类型的媒体数据的适配集合之间进行切换。 In this manner, client device 40 may receive a request to switch between a set of the same type adapted media data. 例如，用户可以请求从包括第一语言的音频或者定时文本数据的适配集合切换到包括第二、不同的语言的音频或者定时文本数据的适配集合。 For example, a user may request set comprising adapting audio switch from a first language into text data or the timing of adaptation set comprises a second, different language audio or timed text data. 作为另一个示例，用户可以请求从包括第一照相机角度的视频数据的适配集合切换到包括第二、不同的照相机角度的视频数据的适配集合。 As another example, a user may request set is adapted to switch from a first camera angle to the video data comprises a second set of adaptation, different camera angles of video data.
[0043] 在图1的示例中，内容准备设备20包括音频源22和视频源24。 [0043] In the example of Figure 1, the apparatus 20 includes an audio content ready source 22 and a video source 24. 音频源22可以包括，例如，产生表示将要由音频编码器26来编码的所捕获的音频数据的电信号表示的麦克风。 The audio source 22 may comprise, for example, be generated by a microphone it represents the audio encoder 26 encodes the electric signals captured audio data representation. 替代地，音频源22可以包括存储之前记录的音频数据存储介质，诸如计算机化的合成器的音频数据生成器或者任何其它音频数据源。 Alternatively, the audio source 22 may include audio data previously stored in the storage medium recording such as a computerized synthesizer to generate audio data or any other source of audio data. 视频源24可以包括产生将要由视频编码器28来编码的视频数据的摄像机、编码有之前记录的视频数据的存储介质、诸如计算机图形源的视频数据生成单元或者任何其它视频数据源。 Video source 24 may include a storage medium to generate the video data to a video encoder 28 to encode the video data of the camera, encoding prior to recording, such as video data generating unit of a computer graphics source or any other source of video data. 内容准备设备20不一定在所有示例中通信地耦合到服务器设备60，但是可以将多媒体内容存储至由服务器设备60读取的单独的介质。 20 are not necessarily separate media content in all of the examples to prepare the device communicatively coupled to the server device 60, but it can be read by the multimedia content stored in the server device 60.
[0044]原始音频和视频数据可以包括模拟或者数字数据。 [0044] The original audio and video data may include an analog or digital data. 模拟数据可以在由音频编码器26和/或视频编码器28编码之前就被数字化。 Analog data may be digitized prior to 28 by the encoder 26 and audio encoder / or video encoder. 音频源22可以在讲话参与者正在讲话时从讲话参与者获得音频数据，并且视频源24可以同时获得讲话参与者的视频数据。 The audio source 22 may obtain audio data from a speaking participant is speaking participant is speaking, the video source 24 and the speaking participant may be obtained with video data. 在其它的示例中，音频源22可以包括计算机可读的存储介质，其包括所存储的音频数据，并且视频源24可以包括计算机可读的存储介质，其包括所存储的视频数据。 In other examples, the audio source 22 may comprise a computer-readable storage medium, comprising stored audio data, and video source 24 may include a computer readable storage medium, which includes video data stored. 以这种方式，可以将本公开内容中所描述的技术应用到直播、流传输、实时音频和视频数据，或者应用到已归档的、预先记录的音频和视频数据。 In this manner, the technology described in this disclosure may be to live, streaming, real-time audio and video data, or to a archived, audio and video data previously recorded.
[0045]对应于视频帧的音频帧通常包括与由视频源24捕获包括在视频帧内的视频数据同时地由音频源22捕获的音频数据。 [0045] corresponding to the video frame and the audio frame typically contains data captured by video source 24 comprises a simultaneously captured by the audio source 22 in the video data of the video frame of audio. 例如，在讲话参与者通常通过讲话产生音频数据时，音频源22捕获音频数据，并且视频源24同时(也就是说，当音频源22正在捕获音频数据时)捕获讲话参与者的视频数据。 For example, when the speaking participant speech typically produces audio data, the audio source 22 captures audio data and the video source 24 simultaneously (that is to say, when the audio source 22 is capturing audio data) captured video data speaking participant. 因此，音频帧可以时间上对应于一个或多个特定的视频帧。 Therefore, the audio frame may correspond to one or more particular video frame time. 因此，对应于视频帧的音频帧通常对应于音频数据和视频数据被同时捕获的情形，并且针对所述情形，音频帧和视频帧分别包括同时捕获的音频数据和视频数据。 Thus, a video frame corresponding to the audio frame typically corresponds to the case of audio data and video data are simultaneously captured, and the case for the audio and video frames include audio data and video data captured simultaneously.
[0046] 音频编码器26通常产生经编码的音频数据的流，而视频编码器28产生经编码的视频数据的流。 [0046] Audio encoder 26 typically produce a stream of encoded audio data, the video encoder 28 generates encoded video stream data. 数据(无论是音频还是视频)的每个个体的流都可以被称为基本流。 Each individual data stream (whether audio or video) may be referred to as an elementary stream. 基本流是表示的单个的、经数字编码(可能是压缩)的分量。 Elementary stream is represented by a single, digitally coded (possibly compressed) component. 例如，表示的经编码的视频或者音频部分可以是基本流。 For example, encoded video or audio portion of the stream may be substantially represented. 基本流在被封装在视频文件内之前可以被转换成分组化的基本流(PES)。 Elementary stream before being encapsulated within the video files can be converted to packetized elementary stream (PES). 在相同的表示内，流ID可以被用于将属于一个基本流的PES-分组与其它分组区分开。 In the same representation, the stream ID can be used to belong to a packet elementary stream PES- region separated from the other packets. 基本流的数据的基本单元是分组化的基本流(PES)分组。 Basic unit of data of the elementary stream is packetized elementary stream (PES) packet. 因此，经编码的视频数据通常对应于基本视频流。 Thus, the encoded video data generally corresponds to the base video stream. 相似地，音频数据对应于一个或多个相应的基本流。 Similarly, the audio data corresponding to one or more corresponding elementary stream.
[0047]与许多视频编码标准一样，H.264/AVC定义了用于无错比特流的语法、语义、以及译码过程，其中的任何项都是符合一定的轮廓(profile)或者级别的。 [0047] Like many video coding standards, H.264 / AVC defines a bit stream for the error-free syntax, semantics, and the decoding process, which is any item meet certain profile (Profile) or level. H.264/AVC不指定编码器，但是编码器的任务是保证所生成的比特流是符合译码器的标准的。 H.264 / AVC encoder is not specified, but the task of the encoder is to ensure that the generated bit stream is a compliant decoder. 在视频编码标准的上下文中，“轮廓”对应于算法、特性或者工具以及对其施加的限制的子集。 In the context of video coding standards, a "profile" corresponds to the algorithm, as well as characteristics or a subset of tools to limit applied. 如由H.264标准所定义的，例如，“轮廓”是由H.264标准指定的整个比特流语法的子集。 As defined by the H.264 standard, for example, "profile" is a subset of the entire bit stream syntax specified by the H.264 standard. “级别”对应于对译码器资源消耗(例如，译码器存储器和计算)的限制，这是与图片的分辨率、比特速率、以及宏块(MB)处理速率相关的。 "Level" corresponds to the limitation of the decoder resource consumption (e.g., memory and computational decoder), which is the image resolution, bit rate, and a macro block (MB) associated processing rate. 可以利用profilejdc(轮廓指示符)值来用信号发送轮廓，而可以利用leVel_idc(级别指示符)值来用信号发送级别。 May be utilized profilejdc (contour indicator) transmitted contour signal value, and may be utilized level_idc (level indicator) value transmitted by the level signal.
[0048]例如，H.264标准认识到，在由给定的轮廓的语法施加的边界内，仍然可能需要取决于通过比特流中的语法要素取得的值的在编码器和译码器的性能方面的大幅度变化，例如经译码的图片的指定大小。 [0048] For example, H.264 standard appreciated that within the boundaries imposed by the syntax of a given profile may still be required depending on the performance value obtained by the bit stream syntax element in the encoder and decoder a substantial change, for example, specify the size of the coded picture. H.264标准进一步认识到，在许多应用中，实现能够处理对特定轮廓内的语法的所有假设使用的译码器既不现实也不经济。 The H.264 standard further recognized that in many applications, implementation can handle both unrealistic to assume that all the syntax within a particular profile using the decoder is not economical. 因而，H.264标准将“级别”定义为施加在比特流中的语法要素的值上的限制的指定集合。 Accordingly, H.264 standard will be "level" is defined as a specified set of restrictions applied on the value of the syntax element in the bitstream. 这些限制可以是对值的简单限制。 These restrictions can be a simple limit on the value. 替代地，这些限制可以采取对值的算术组合的限制的形式(例如，图片宽度乘以图片高度乘以每秒译码的图片数量)』.264标准进一步提供了可以针对每个所支持的轮廓支持不同级别的个体的实现方式。 Alternatively, these restrictions can take the form of restrictions on arithmetic combinations of values ​​(eg, picture width multiplied by picture height multiplied by number of pictures decoded per second). "264 standard further provides for each profile can be supported support different levels of individual implementations. 可以提供多媒体内容的各种表示，以适应H.264内编码的各种轮廓和级别，并且以适应其它编码标准，例如即将出现的高效率视频编码(HEVC)标准。 We can provide a variety of multimedia content representation to fit within the H.264 encoding various contours and levels, and to accommodate other coding standards, such as high efficiency video coding upcoming (HEVC) standard.
[0049]符合轮廓的译码器通常支持轮廓中所限定的所有特征。 [0049] The decoder generally follows the contours of support all the features defined profile. 例如，作为编码特征，在H.264/AVC的基线轮廓中不支持B-图片编码，但是在H.264/AVC的其它轮廓中支持B-图片编码。 For example, coding feature is not supported B- picture encoding in the H.264 / AVC baseline profile, the support but B- picture encoding in the H.264 / AVC in other profiles. 符合特定级别的译码器应该能够将不需要超过级别中所限定的限制的资源的任何比特流译码。 Decoding the bit stream in line with any particular level of the decoder should be able to level need not exceed defined limits of the resources. 对轮廓和级别的限定可能对可解释性有帮助。 It may be helpful for interpretability of the profile and level of qualification. 例如，在视频传输期间，可以针对整个传输会话对轮廓和级别的限定对进行协商并且达成一致。 For example, during video transmission, the transmission can be for the entire session to outline and define the level of consultation and consensus. 更加具体来说，在H.264/AVC中，例如，级别可以限定需要被处理的块的数量的限制、经译码图片缓冲器(DPB)的大小、经编码图片缓冲器(CPB)的大小、垂直运动向量范围、每两个连续MB的运动向量的最大数量以及B-块是否可以具有小于8X8像素的子块划分。 More specifically, in the H.264 / AVC, for example, the level to be processed can define an unlimited number of blocks, the size of the coded picture buffer (the DPB), the coded picture buffer (CPB) size , the range of vertical motion vectors, the maximum number of every two consecutive motion vector and MB B- block is divided into sub-block may have less than 8X8 pixels. 以这种方式，译码器可以确定译码器是否能够恰当地将比特流译码。 In this manner, the decoder may determine whether the coder bit stream can be properly decoded.
[0050]诸如ITU-T H.261、H.262、H.263、MPEG-l、MPEG-2、H.264/MPEG-4part 10之类的视频压缩标准以及即将出现的高效率视频编码(HEVC)标准利用运动压缩时间预测以降低时间冗余。 [0050] such as ITU-T H.261, H.262, H.263, MPEG-l, MPEG-2, video compression standard H.264 / MPEG-4part 10 such high efficiency video coding and emerging ( HEVC) time compression standard using motion prediction to reduce temporal redundancy. 编码器(例如，视频编码器28)可以使用来自一些之前经编码的图片(也称为帧)的运动补偿预测以根据运动向量来预测当前经编码的图片。 An encoder (e.g., the video encoder 28) may use some of the warp from the encoded image (also called frames) to the motion compensated prediction motion vector predicting a current picture coded before. 在典型的视频编码中，存在三种主要的图片类型。 In a typical video encoding, there are three main types of pictures. 它们是内部编码图片(“1-图片”或者“1-帧”)、预测图片(“P-图片”或者“P-帧”)以及双向预测图片(“B-图片”或者“B-帧U-图片可以在时间次序上在当前的图片之前使用参考图片。在B-图片中，可以从一个或两个参考图片来预测B-图片的每个块。这些参考图片可以在时间顺序上位于当前的图片之前或者之后。 They are intra-coded picture ( "1- picture" or "a 1-frame"), predicted pictures ( "the P-picture" or "the P-frames") and bi-predictive picture ( "B- picture" or "B- frame U - image can be used in time sequence before the current picture in the reference picture B- picture, each block can be predicted from a picture B- or these two reference pictures can be reference pictures in the current in time sequence. pictures before or after.
[0051]参数集合通常在序列参数集合(SPS)中包括序列层报头信息，并且在图片参数集合(PPS)中包括不频繁变化的图片层报头信息。 [0051] The set of parameters in a sequence parameter set is usually (SPS) in the sequence layer comprises header information, and the set (PPS) comprises a picture layer header information is not frequently changed in the picture parameter. 利用参数集合，这种不频繁变化的信息不需要针对每个序列或者图片而被重复；因此，可以提高编码效率。 Using the parameter set, this information need not infrequently changing is repeated for each sequence or picture; thus, can improve the coding efficiency. 此外，参数集合的使用可以使报头信息能够带外传输，避免为了获得差错恢复而对冗余传输的需求。 In addition, the set of parameters may cause the header information can be transmitted outside the band, in order to obtain an error recovery while avoiding the need for redundant transmission. 在带外传输中，在与其它NAL单元不同的通道上传输参数集合NAL单元。 Outside the transmission band, on the other NAL units with different channel transmission parameter set NAL units.
[0052] 在图1的示例中，内容准备设备20的封装单元30从视频编码器28接收包括经编码视频数据的基本流，并且从音频编码器26接收包括经编码的音频数据的基本流。 [0052] In the example of Figure 1, the package unit content preparation apparatus 20 of 30 receiving an elementary stream including the encoded video data from the video encoder 28, and receives audio data including encoded elementary stream from the audio encoder 26. 在一些示例中，视频编码器28和音频编码器26可以各自包括分组器，以用于从经编码的数据形成PES分组。 In some examples, video encoder 28 and audio encoder 26 may each include a packet, a PES packet for forming the encoded data. 在其它示例中，视频编码器28和音频编码器26可以各自与相应的分组器接口，以用于从经编码的数据形成PES分组。 In other examples, video encoder 28 and audio encoder 26 may each interface with a respective packet to form a PES packet for the encoded data. 在另外的示例中，封装单元30可以包括用于从经编码的音频和视频数据形成PES分组的分组器。 In a further example, the package may include a unit 30 for forming the PES packet is a packet from the encoded audio and video data.
[0053]视频编码器28可以以多种方式对多媒体内容的视频数据进行编码，以在各种比特速率下并且利用各种特性(例如，像素分辨率、帧速率、对各种编码标准的符合性、对各种编码标准的各种轮廓和/或轮廓的级别的符合性、具有一个或多个视图(例如，用于二维或者三维播放)的表示或者其它这样的特性)来产生对多媒体内容的不同的表示。 [0053] Video encoder 28 may encode video data of the multimedia content in a variety of ways, at various bit rates to and with various characteristics (e.g., pixel resolution, the frame rate, consistent with the various coding standards compliance, having one or more views (e.g., for two or three dimensional displays) or other representation of such characteristics, various contours of the various levels of coding standards and / or profile) to generate a multimedia different representations of the content. 如在本公开内容中所使用的，表示可以包括音频数据和视频数据的组合，例如，一个或多个音频基本流和一个或多个视频基本流。 As used in this disclosure, the representation may comprise a combination of audio data and video data, e.g., one or more audio elementary stream and one or more video elementary streams. 每个PES分组可以包括标识PES分组属于的基本流的stream_id。 Each PES packet may comprise elementary stream identifier stream_id PES packet belongs. 封装单元30负责将基本流汇集成各种表示的视频文件。 Packaging unit 30 is responsible for the file into a video elementary stream together the various representations.
[0054]封装单元30从音频编码器26和视频编码器28接收表示的基本流的PES分组，并且从PES分组形成对应的网络抽象层(NAL)单元。 [0054] PES 30 elementary stream encapsulation unit represented by the audio encoder 26 and a video encoder 28 receives from the packet, and the packet is formed corresponding to the network abstraction layer (NAL) units from the PES. 在H.264/AVC(高级视频编码)的示例中，将经编码的视频片段组织成为NAL单元，其提供“网络友好”的视频表示处理应用，例如，视频电话、存储器、广播或者流传输。 In the example of H.264 / AVC (Advanced Video Coding), the NAL unit becomes the encoded video segment tissue, which provides a "network friendly" represents video processing applications, such as video telephony, memory, broadcast or streaming. NAL单元可以被分类到视频编码层(VCL)NAL单元和非VCL NAL单元。 NAL units may be classified into a video coding layer (the VCL) NAL units and non-VCL NAL units. VCL单元可以包括核心压缩引擎，并且可以包括块、宏块和/或截片(slice)级的数据。 VCL compression unit may include a core engine, and may include a block, macroblock, slice and cut (Slice) Level of data and / or. 其它NAL单元可以是非VCL NAL单元。 Other NAL units may be non-VCL NAL units.
[0055]封装单元30可以向输出接口 32提供多媒体内容的一个或多个表示的数据以及清单文件(例如，MPD)。 Data [0055] The encapsulation unit 30 may provide multimedia content to the output interface 32, and one or more representations of the manifest file (e.g., MPD). 输出接口32可以包括网络接口或者用于向存储介质写入的接口，例如，通用串行总线(USB)接口、CD或者DVD写入器或者烧录器、到磁存储介质或者闪速存储介质的接口、或者用于存储或者发送媒体数据的其它接口。 Output interface 32 may include an interface or a network interface for writing to the storage medium, e.g., a universal serial bus (USB) interface, CD or DVD burner or a write, to the magnetic storage medium or a flash memory medium, interface, or other interface for storing or transmitting media data. 封装单元30可以向输出接口32提供多媒体内容的表示中的每个表示的数据，所述输出接口32可以经由网络传输、直接传输、或者存储介质向服务器设备60发送数据。 Each data represents the encapsulation unit 30 may provide multimedia content to the output interface 32 represents the interface 32 can send data to the server device 60 via network transmission, direct transmission, or storage medium output. 在图1的示例中，服务器设备60包括存储各种多媒体内容64的存储介质42，每个所述多媒体内容64包括相应的清单文件66和一个或多个表示68A至68N(表示68)。 In the example of Figure 1, the server device 60 includes a storage medium 64 stores various multimedia contents of 42, 64 each comprise a respective multimedia contents manifest file 66 and one or more representations 68A to 68N (represented by 68). 根据本公开内容的技术，可以将清单文件66的部分存储在分离的位置，例如，存储介质62或者网络74中的潜在的另一个设备(例如，代理设备)的另一个存储介质的位置。 The techniques of this disclosure may be in a separate location, e.g., the position of the storage medium 62 or the network 74 potential another device (e.g., proxy device) to another storage media storage portion 66 of the manifest file.
[0056]可以将表示68分成适配集合。 [0056] 68 may be expressed into the adaptation set. 也就是说，表示68的各种子集可以包括特性的相应公共集合，例如，编解码器、轮廓和级别、分辨率、视图数、片段的文件格式、可以标识将利用表示显示的文本的语言或者其它特性的文本类型信息、和/或将被编码和例如由扬声器呈现的音频数据、将例如由扬声器、可以针对适配集合中的表示而描述照相机角度或者真实世界的场景的相机视角的相机角度信息、针对特定的观众描述内容合适性的评级信息等。 That is, 68 denotes various subsets may include respective common set of characteristics, e.g., codecs, profiles and levels, resolution, number of views, clip file formats may be identified by using the display language text represented or text type information, and / or audio data to be encoded and other characteristics such as presented by the speaker, the speaker for example, can be described camera view of the scene or camera angle camera for real-world representation of the adapter set angle information, an appropriate description of the rating information for specific audiences.
[0057]清单文件66可以包括对应于特定的适配集合的表示68的子集的数据指示以及适配集合的公共特性。 [0057] 66 may include a manifest file corresponding to a particular set of data representing adaptation indicating subset 68 and a common set of characteristic adaptation. 清单文件66还可以包括适配集合的个体的表示的个体的特性(例如，比特速率)的数据表示。 Data 66 may further include a manifest file represents an individual adaptation of the individual set of characteristics (e.g., bit rate) representation. 以这种方式，适配集合可以提供简化的网络带宽适配。 In this manner, adaptation set may provide a simplified network bandwidth adaptation. 可以使用清单文件66中的适配集合要素的子要素来指示适配集合中的表示。 You can use a set of sub-elements adapted elements of the manifest file to indicate 66 indicates an adapter set.
[0058] 服务器设备60包括请求处理单元70和网络接口72。 [0058] The server device 60 includes a request processing unit 70 and a network interface 72. 在一些示例中，服务器设备60可以包括多个网络接口，包括网络接口72。 In some examples, the server device 60 may include a plurality of network interfaces, a network interface 72. 此外，可以在内容分布网络的其它设备(例如，路由器、桥、代理设备、交换机或者其它设备)上实现服务器设备60的特征中的全部或任何特征。 Further, any or all of the features in the server device 60 may be implemented on other devices (e.g., a router, a bridge, a proxy device, a switch or other device) Content Distribution Network. 在一些示例中，内容分布网络的中间设备可以缓存多媒体内容64的数据，并且包括与服务器设备60的那些部件大体上一致的部件。 In some examples, the content distribution of the intermediate devices of the network may cache the multimedia content data 64, and includes substantially identical to those components of the server device 60 components. 通常，网络接口72被配置为经由网络74来发送和接收数据。 Typically, the network interface 72 is configured to transmit and receive data via the network 74.
[0059]请求处理单元70被配置为针对存储介质62的数据从客户端设备(例如，客户端设备40)接收网络请求。 [0059] The request processing unit 70 is configured to receive the network request from the client device (e.g., client device 40) for the data storage medium 62. 例如，请求处理单元70可以实现在RFC 2616，“Hyper TransferProtocol-HTTP/1.1”，R.Feilding等人，网络工作组(Network Working Group)，IETF, 1999年六月中所描述的超文本传输协议(HTTP)版本1.1。 For example, the request processing unit 70 may be implemented in RFC 2616, "Hyper TransferProtocol-HTTP / 1.1", R.Feilding et al., Network Working Group (Network Working Group), IETF, June 1999 described in the Hypertext Transfer Protocol (HTTP) version 1.1. 也就是说，请求处理单元70可以被配置为接收HTTP GET或者部分GET请求，并且响应于请求而提供多媒体内容64的数据。 That is, the request processing unit 70 may be configured to receive a portion of the HTTP GET or GET request, and in response to a request of providing multimedia content data 64. 请求可以例如使用片段的URL来指定表示68中的一个表示的片段。 For example, using a fragment request URL to specify a segment 68 represents FIG. 在一些示例中，请求还可以指定片段的一个或多个字节范围。 In some examples, the request may also specify a segment or plurality of byte ranges. 在一些示例中，可以使用部分GET请求来指定片段的字节范围。 In some examples, you may be used to specify the partial GET request byte range segment. 在其它示例中，根据本公开内容的技术，可以例如根据通用模板将片段的字节范围指定为片段的URL的一部分。 In other examples, in accordance with the techniques of this disclosure may be, for example, specified as part of the URL according to a byte range segment generic template fragment.
[0060] 请求处理单元70可以进一步被配置为服务HTTP HEAD请求，以提供表示68中的一个表示的片段的报头数据。 [0060] The request processing unit 70 may be further configured to serve HTTP HEAD request to provide a data segment header 68 shown in FIG. 在任何情况下，请求处理单元70可以被配置为处理请求以向请求设备(例如，客户端设备40)提供所请求的数据。 In any case, the request processing unit 70 may be configured to process data requests (e.g., client device 40) provided to the requesting device requests. 此外，处理器单元70可以被配置为生成用于构造URL的模板，所述URL指定字节范围，提供指示模板是所需要的还是可选的信息，并且提供指示任何字节范围都是可接受的还是只允许字节范围的特定的集合的信息。 Further, the processor unit 70 may be configured to generate a template for constructing a URL, the URL specified byte range, providing an indication of the template information is required or optional, and provide an indication of any byte range is acceptable specific set of information is only a byte range. 当仅允许特定的字节范围时，请求处理单元70可以提供对所允许的字节范围的指示。 When only allows certain byte range request processing unit 70 may provide an indication of the allowable byte range.
[0061]如在图1的示例中所示出的，多媒体内容64包括清单文件66，所述清单文件66可以对应于媒体呈现描述(MH))。 [0061] As shown in the example of Figure 1, the multimedia content 64 comprises a manifest file 66, the file list 66 may correspond to a media presentation description (MH)). 清单文件66可以包括对不同的替代表示68(例如，具有不同质量的视频服务)的描述，并且描述可以包括例如编解码器信息、轮廓值、级别值、比特速率以及表示68的其它描述性特性。 List file 66 may include a representation of various alternative 68 (e.g., video services with different quality) is described, and the description may include, for example, codec information, profile value, a level value, the bit rate, and indicates other descriptive properties 68 . 客户端设备40可以取回媒体表示的MPD，以确定如何访问表示68的片段。 The client device 40 may retrieve the media that the MPD to determine how to access the 68 fragments expressed.
[0062] 客户端设备40的网络应用52可以包括由客户端设备40的基于硬件的处理单元来执行的网络浏览器，或者这样的网络浏览器的插件。 [0062] The client device network application 52 may include a plug 40 by the client device hardware-based processing unit to execute the web browser 40, or such a web browser. 对网络应用52的引用通常应该被理解为包括或者网络应用程序(例如，网络浏览器、独立视频播放器)，或者并入了网络浏览器的播放插件的网络浏览器。 A reference network application 52 should generally be understood to include a network or application (e.g., web browser, an independent video player), or incorporated in the web browser displays the web browser plug-in. 网络应用程序52可以取回客户端设备40的配置数据(未示出)，以确定客户端设备40的视频译码器48的译码能力和视频输出44的渲染能力。 Web application 52 may retrieve the configuration data of the client device (not shown) 40 to determine the client device 40 of the video decoder 48 decodes the video output capability and rendering capabilities 44.
[0063]配置数据还可以包括由客户端设备40的用户来选择的默认语言偏好、一个或多个默认照相机视角(例如，由客户端设备40的用户来设置的深度偏好)和/或由客户端设备40的用户来选择的评级偏好中的任何或全部项。 [0063] The configuration data may also include the client device 40 by the client to select a default language preference, one or more default camera angle of view (e.g., the client device 40 by the client to set the depth of preferences), and / or by the customer any client device 40 to select a rating preference or all items. 网络应用程序52可以包括例如被配置为提交HTTP GET和部分GET请求的网络浏览器或者媒体客户端。 Web application 52 may comprise, for example, be configured to submit a web browser and a HTTP GET request or a partial GET media client. 网络应用52可以对应于由客户端设备40的一个或多个处理器或者处理单元(未示出)执行的软件指令。 52 may correspond to a web application software instructions executed by a client terminal device 40 or more processors or processing units (not shown). 在一些示例中，可以在硬件或者硬件、软件和/或固件的组合(其中，提供必要的硬件以执行软件或者固件的指令)中实现关于网络应用52描述的功能中的全部或部分功能。 In some examples, the hardware may be implemented in hardware, or a combination of software and / or firmware (which provides the necessary hardware to execute software or firmware instructions) implemented on all or part of functions of the network application function described in 52.
[0064]网络应用52可以将客户端设备40的译码和渲染能力与由清单文件66的信息所指示的表示68的特性进行对比。 [0064] The web application 52 may decode and rendering capabilities of the client device 40 is compared with the list of information represented by the file 66 as indicated by characteristic 68. 网络应用52可以初始地取回清单文件66的至少一部分以确定表示68的特性。 Web application 52 may initially retrieve at least a portion of the manifest file 66 to determine a characteristic 68. 例如，网络应用52可以请求描述了一个或多个适配集合的特性的清单文件66的一部分。 For example, the web application 52 may request depicts a portion of one or more characteristics of the manifest file adapter set 66. 网络应用52可以选择具有可以由客户端设备40的编码和渲染能力来满足的特性的表示68的子集(例如，适配集合)。 Web application 52 may represent a subset select 68 having characteristics may be encoded by the customer premise equipment and rendering capabilities to meet the 40 (e.g., a set of adaptation). 然后，网络应用52可以确定适配集合中的表示的比特速率，确定网络带宽的当前可用的量，并且从具有可以由网络带宽满来足的比特速率的表示中的一个表示取回片段(或者字节范围。) Then, the bit rate represented by the network application 52 may determine a set of adaptation, determining the amount of current available network bandwidth, and indicates fragment retrieved from the bit rate can be represented with a full network bandwidth to the one foot (or byte range.)
[0065]通常，较高比特速率的表示可以产生较高质量的视频播放，而当可用的网络带宽降低时，较低比特速率的表示可以提供足够质量的视频播放。 [0065] Generally, the higher the bit rate representation can produce higher quality video playback, and when the available network bandwidth decreases, showing a lower bit rate can provide sufficient quality of video playback. 因此，当可用的网络带宽相对高时，网络应用52可以从相对高比特速率的表示中取回数据，反之，当可用的网络带宽低时，网络应用52可以从相对低比特速率的表示取回数据。 Thus, when the available network bandwidth is relatively high, the web application 52 may retrieve data from a relatively high bit rate expressed in the other hand, when the available network bandwidth is low, the web application 52 may represent retrieved from a relatively low bit rate data. 以这种方式，客户端设备40可以通过网络74来流传输多媒体数据，同时还使自己适应于改变网络74的网络带宽可用性。 In this manner, client device 40 may be 74 streaming multimedia data over the network, while also adapting itself to changes in the network 74 of the network bandwidth availability.
[0066]如上所述，在一些示例中，客户端设备40可以向例如服务器设备60或者内容分布网络的其它设备提供用户信息。 [0066] As described above, in some examples, client device 40 may provide the user information to other devices such as a server device 60 or the content distribution network. 用户信息可以采用浏览器网络跟踪器(cookie)的形式，或者可以采用其它形式。 The user information may take the form of a browser cookie (Cookie), or may take other forms. 例如，网络应用52可以收集用户标识符、用户标识符、用户偏好和/或用户人口统计信息，并且将这样的用户信息提供至服务器设备60。 For example, the web application 52 may collect user identifier, a user identifier, user preferences and / or user demographic information, and provides such information to the server device 60 the user. 然后，网络应用52可以接收与目标广告媒体内容相关联的清单文件，以在播放期间使用以将来自目标广告媒体内容的数据插入到所请求的媒体内容的媒体数据中。 Then, the web application 52 may receive the media content related to the linked targeted advertisement file list, for use during the data playback from the media content targeted advertising is inserted into the media data of the media content requested. 可以直接将该数据作为请求清单文件或者清单子文件的结果而接收，或者可以经由重定向到替代的清单文件或者子文件的HTTP来接收该数据(基于用于存储用户人口学和其它目标信息的所提供的浏览器网络跟踪器)。 As a direct result of the data file or a list of requests received subfile list, or may receive the data (for storing user based on demographic and other information via a redirect to target alternative manifest file of an HTTP or subfolder provided by the browser cookie).
[0067]有时，客户端设备40的用户可以使用客户端设备40的用户接口(例如，键盘、鼠标、触摸笔、触摸屏界面、按钮或者其它接口)与网络应用52进行交互，以请求多媒体内容(例如，多媒体内容64)。 [0067] Sometimes, the user of the client device 40 may use the user interface to the client device 40 (e.g., a keyboard, a mouse, a touch pen, touch screen interface, a button or other interface) to interact with the network applications 52 to request multimedia content ( For example, multimedia content 64). 响应于来自用户的这样的请求，网络应用52可以基于例如客户端设备40的译码和渲染能力来选择表示68中的一个表示。 In response to such a request from the user, the web application 52 may be based, for example, decoding and rendering capabilities of the client device 40 to select a representation 68 of FIG. 为了取回表示68中的所选择的一个表示的数据，网络应用52可以顺序地请求表示68中的所选择的一个表示的具体字节范围。 To retrieve data representing a representation of the selected 68, the web application 52 may be sequentially showing particular byte range request 68 in a selected representation. 以这种方式，网络应用52可以通过多个请求来顺序地接收文件的部分，而不是通过一个请求来接收完整的文件。 In this manner, the web application 52 may be received by a plurality of document request part sequentially rather than a request received by the complete file.
[0068]在一些示例中，服务器设备60可以指定来自客户端设备(例如，客户端设备40)的URL的通用模板。 [0068] In some examples, the server device 60 may specify a generic template from a client device (e.g., client device 40) of the URL. 继而，客户端设备40可以使用模板来构造用于HTTP GET请求的URL。 In turn, the client device 40 may be configured to use a template URL HTTP GET request. 在DASH协议中，URL是或者通过在每个片段内明确地列出它们，或者是通过给出URL模板来形成的，所述URL模板包括一个或多个公知的模式(例如，$$、$Representat1nID$、$Index$、$Bandwith$或者$Time$(由DASH的当前稿的表格9描述的)。在做出URL请求之前，客户端设备40可以将诸如“W”、表示识别、片段的索引等的文本字符串替换成URL模板以生成将要取来的最终的URL。本公开内容定义了可以被添加到例如多媒体内容的MPD (例如，多媒体内容64的清单文件66)中的DASH文件的SegmentInfoDefault元素的若干个额外的XML字段。 In DASH protocol, or by a URL list them, or are formed by a given URL template, said template comprising one or more URL known pattern within each segment (e.g., $ $ $ before Representat1nID $, $ Index $, $ Bandwith $ or $ $ Time (by the current draft table described DASH 9). URL making the request, the client device 40 may be such as "W", it represents recognition, fragments indexing text string replaced URL template to generate to be taken to the final URL. the present disclosure is defined can be added to e.g. DASH file MPD multimedia content (e.g., multimedia content, the manifest file 64 of 66) several additional fields SegmentInfoDefault XML elements.
[0069]响应于由网络应用52向服务器设备60提交的请求，网络接口 54可以接收并向网络应用程序提供所接收的所选择的表示的片段的数据。 [0069] In response to a request submitted to the server device 60 by the web application 52, the network interface 54 may receive data segments and provide the received representation of the selected network applications. 网络应用52可以继而向解封装单元50提供分段。 Web application 52 may then provide to the decapsulating unit 50 segments. 解封装单元50可以将视频文件的要素解封装成构成PES流，将PES流解分组以取回经编码的数据，并且取决于，例如由流的PES分组报头所指示的，经编码的数据是音频流的一部分还是视频流的一部分，而将经编码的数据发送到音频译码器46或者视频译码器48。 Decapsulating unit 50 may be a video file feature solutions packaged into constituent PES stream, the PES packet stream to retrieve a solution coded data, and depending on, for example, a packet header of the PES stream indicated, the encoded data or part of the audio portion of the video stream stream, and transmits the encoded data to the audio decoder 46 or the video decoder 48. 音频译码器46将经编码的音频数据译码，并且将经译码的音频数据发送至音频输出42，而视频译码器48将经编码的视频数据译码，并且将包括多个流的视图的经译码的视频数据发送到视频输出44。 The audio decoder 46 decodes the encoded audio data via, and sends the audio to output the audio data decoder 42, the video decoder 48 decodes the video encoded data, and comprises a plurality of streams transmitting coded video data to the view of the video output 44.
[0070] 视频编码器28、视频译码器48、音频编码器26、音频译码器46、封装单元30、网络应用52以及解封装单元50可以各自被实现为各自合适的处理电路中的任何处理电路(如果适用的话)，例如，一个或多个微处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)、分立的逻辑电路、软件、硬件、固件或者其任何组合。 [0070] Video encoder 28 and video decoder 48, audio encoder 26, an audio decoder 46, packaging unit 30, and a network application 52 decapsulating unit 50 may each be implemented in any suitable respective processing circuit to processing circuitry (if applicable), e.g., one or more microprocessors, digital signal processors (DSP), application specific integrated circuit (ASIC), a field programmable gate array (the FPGA), discrete logic, software, hardware, , firmware, or any combination thereof. 视频编码器28和视频译码器48中的每项都可以被包括在一个或多个编码器或者译码器中，其中的任一项可以被集成为组合的视频编码器/译码器(CODEC)的一部分。 Video encoder 28 and video decoder 48 each may be included in one or more encoders or decoders, either of which may be integrated into a combined video encoder / decoder ( part of CODEC) in. 同样地，音频编码器26和音频译码器46中的每项可以被包括在一个或多个编码器或者译码器中，其中的任一项可以被集成为组合的⑶DEC的一部分。 Similarly, the audio encoder 26 and the audio decoder 46 each may be included in one or more encoders or decoders, either of which may be integrated as a part of the combination of ⑶DEC. 包括视频编码器28、视频译码器48、音频编码器26、音频译码器46、封装单元30、网络应用52和/或解封装单元50的装置可以包括集成电路、微处理器和/或无线通信设备，例如，蜂窝电话。 28 includes a video encoder, a video decoder 48, audio encoder 26, an audio decoder 46, packaging unit 30, network applications and / or devices 52 decapsulating unit 50 may comprise an integrated circuit, a microprocessor, and / or wireless communications device, e.g., a cellular telephone.
[0071]以这种方式，客户端设备40表示用于取回媒体数据的设备的示例，其中，设备可以包括一个或多个处理器，所述一个或多个处理器被配置为从包括第一类型的媒体数据的第一适配集合取回媒体数据，呈现来自第一适配集合的媒体数据，响应于切换到包括第一类型的媒体数据的第二适配集合的请求:从第二适配集合取回包括第二适配集合的切换点的媒体数据，并且在实际的播出时间已经满足或者超过针对切换点的播出时间之后，呈现来自第二适配集合的媒体数据。 [0071] In this manner, the client device 40 indicates an example of the apparatus for retrieving media data, wherein the device may include one or more processors, the one or more processors are configured from the group consisting of fitting a first set of types of media data retrieved media data, the media presentation data from the first set is adapted, in response to a first type of request comprising the second media data to the switching to the adapted set of: the second retrieving a set of data including the media adapter switching points of the second set of adaptation, and the actual broadcast have been met or exceeded for a time after broadcast time of the switching point, rendering the media data from the second set of adaptation.
[0072]本公开内容的技术可以应用在以下的上下文中:针对时段Pl，数据已经被完全下载，并且在下一个时段P2中，下载已经开始。 [0072] The present technical disclosure may be applied in the context of the following: for the period Pl, the data has been completely downloaded, and the next period P2, the download has started. 在一个示例中，数据缓冲器包括针对Pl的大约值20秒的播放的数据，并且针对P2值5秒的播放的数据，并且用户当前正在观看Pl的内容。 In one example, the data buffer includes a data value of about 20 seconds for a playback Pl and P2 for the data value of 5 seconds of playback, and the user is currently viewing the contents of Pl. 此时，用户发起适配集合改变，例如，将音频从英语改变成法语。 At this point, the user initiates a set of adaptation to change, for example, the audio is changed from English into French. 在常规的技术中，可能产生这样的问题，如果源部件(例如，网络应用52)将仅针对P2反映该变化，则用户将在大约20秒之后观察到该变化，这是负面的用户体验。 In the conventional technique, it may be such a problem, if the source member (e.g., network application 52) only for P2 reflect the change, the user will observe this change after about 20 seconds, which is a negative user experience. 另一方面，如果在Pl和P2两者上反映变化，则P2中的改变可能不能准确地反映在P2的开始处。 On the other hand, if the change is reflected in both the Pl and P2, and P2 is changed it may not be accurately reflected in the beginning of the P2. 本公开内容的技术可以提供解决方案，其中源部件(例如，服务器设备60的请求处理单元)可以在时段Pl和P2两者上反映改变，并且为了从P2的开始起反映改变，源部件可以在P2上向P2的开始时间发出SEEK事件。 The techniques of this disclosure may provide a solution, wherein the source member (e.g., a server device request processing unit 60) may reflect changes in both the periods Pl and P2, and P2 in order starting from the start to reflect the change, the source member can be P2 on the issue SEEK event to the start time P2. 这样的SEEK事件可以涉及源部件侧上的额外的同步逻辑单元。 Such events may involve additional SEEK synchronization logic cells on the source side of the member.
[0073]本公开内容的技术也可以应用在以下的上下文中:用户快速地发起适配集合改变，特别是利用适配集合B来替换适配集合A，并且然后在快速会话中利用适配集合C来替换适配集合B。 [0073] The techniques of this disclosure may be applied in the context of the following: a user initiated adaptation set change rapidly, in particular by adapting a set of B is adapted to replace the set A, and then using a set of fast adaptation session C is adapted to replace the set B. 可能产生这样的问题，当处理A到B的改变时，适配集合A将从客户端设备内部状态中被移除。 May arise a problem, when processing A to B is changed, the adaptation set A are removed from the internal state of the client terminal device. 因此当发出B到C的改变时，相对于B的下载位置来执行改变。 Thus when issued B to C to change the relative position of B to download the changes performed. 本公开内容的技术可以提供解决方案，其中源部件可以提供新的API，例如，GetCurrentPlaybackTime(type)(获得当前播放时间(类型))，所述新的API接受“type(类型)”作为表示适配集合类型(AUD1(音频)、VIDE0(视频)等)的变元，并且针对该适配集合提供播放位置(例如，以播放时间的形式)。 The techniques of this disclosure may provide a solution, in which the source component may provide a new API, e.g., GetCurrentPlaybackTime (type) (obtained current playback time (type)), to accept the new API "type (Type)" indicates, as appropriate with collection types (AUD 1 (audio), VIDE0 (video), etc.) of the argument, and set the playback position to provide for the adaptation (e.g., in the form of playing time). 该新的API可以被用于确定切换时间。 The new API may be used to determine the switching time. 切换时间可以在适配集合的播放开始时间之前。 Before the playback start time switching time you can fit in the collection. 例如，B开始时间可以在播放时间(P时间)10秒处，但是基于类型的播放位置可以在时间7秒处。 For example, B may be at the start time of playback time (P time) of 10 seconds, but may be based on the type of player positions at a time of 7 seconds. 可以改变PKER核心算法，这是因为缓冲器计算逻辑可能受到影响。 PKER core algorithm can be changed, because the buffer calculation logic may be affected.
[0074]替换地，源部件可能已经包括用于当替换适配集合时供给正确的样本的逻辑单元。 [0074] Alternatively, the source component may already include a logic unit for supplying the correct sample set when the replacement adapter. 例如，客户端设备可以被配置为只在时间10秒以后而不是在之前供给来自适配集合B的样本。 For example, the client device may be configured to not only adapted to supply a sample from set B at a later time prior to 10 seconds. 当发出替换操作时，源部件可以检查针对正被替换的适配集合的播放是否已经开始。 When the replacement operation is issued, the source member can check the player adapted for being replaced set has started. 对于B到C的适配集合切换，针对适配集合B播放可能还没有开始。 B to C is adapted for switching the set, for adapting the set B may not start playback. 如果播放还没有开始，则源部件可以避免针对旧的适配集合向渲染器给出任何数据样本，并且发出以下的命令:REMOVE (移除)(旧的适配集合)[在该情况下REMOVE B]，以及ADD(添加)(新的适配集合)[在该情况下ADD C]。 If the player has not yet started, the source member can be avoided any given set of data samples to a renderer adapted for the old and issue the following commands: REMOVE (removed) (old adaptation set) [In this case, the REMOVE B], and ADD (addition) (new adapter set) [in this case ADD C]. 对源部件的影响应该是最小的。 Effects of the source member should be minimal. 如果渲染器(例如，音频输出42或者视频输出44)将在适配集合B的切换点处/超过适配集合B的切换点处请求样本，则源部件可以确保适配集合A的播放继续。 If the renderer (e.g., video or audio output 42 output 44) is adapted to set the switching point at the B / adapted at the switching point over a set of sample B is requested, the source member can be adapted to ensure that the set A playback continues. 源部件还可以验证相对于A的C的开始位置。 You can also verify the source member with respect to the start position C A.
[0075]在又一个示例上下文中，用户可以从适配集合A切换到适配集合B，然后快速地返回适配集合A。 [0075] In yet another example context, a user may switch from the set A to the adapter adapted set B, then rapidly returns adaptation set A. 在这种情况下，客户端设备40可以避免将适配集合B的样本呈现给用户。 In this case, the client device 40 is adapted to avoid the collection of sample B is presented to the user. 根据本公开内容的技术，源部件可以检测，播放还没有在B上开始，并且类似于上文中所描述的场景，阻止B的样本到达渲染器。 The techniques of this disclosure, the source member can be detected, the play has not yet begun at B, and similar to the scenario described above, sample B reaches the stop renderer. 因此，源部件可以提交以下的命令:REMOVE B，以及立即地ADD A。 Thus, the source member can submit the following command: REMOVE B, and immediately ADD A. 当添加了A时，全局播放统计可以再次被用于确定A的开始时间，所述A的开始时间可能落入已经呈现的数据内。 When A is added, the overall play count may again be used to determine the start time of the A, A start time of the fall of the data may have been rendered. 在这种场景下，源部件可以拒绝SELECT(选择)请求直到当前可用的时间为止。 In this scenario, the source member can reject the SELECT (select) the request until the current time available.
[0076]例如，假设A的数据被下载直到时间30秒为止(并且播放当前在O秒处)。 [0076] For example, assume that the data is downloaded A time of 30 seconds up until (and playback of the current in the second O). 用户可以利用适配集合B来替换适配集合A，并且切换时间已经在2秒处。 Users can use a set of B adapted to replace the adapter set A, and the switching time is 2 seconds in place. 可以清除A的从2秒到30秒的数据。 You can clear data from 2 seconds to 30 seconds of A. 然而，当A被添加回来时，它将以时间O开始并且发出SELECT请求。 However, when A is added back to the time it starts and issues a SELECT O request. 源部件可以拒绝该SELECT请求。 SELECT source member may reject the request. 然后，从时间2秒开始，可以请求元数据。 Then, starting from the time of two seconds, you may request metadata. 源部件将批准在时间2秒处的选择。 Source selection means to be approved at the time of 2 seconds.
[0077]图2是示出了示例多媒体内容100的要素的概念图。 [0077] FIG. 2 is a diagram illustrating an example of a conceptual diagram of elements of the multimedia content 100. 多媒体内容100可以对应于多媒体内容64(图1)，或者存储在存储介质62中的另一个多媒体内容。 100 may correspond to the multimedia content of the multimedia content 64 (FIG. 1), or other multimedia content stored in the storage medium 62. 在图2的示例中，多媒体内容100包括媒体呈现描述(MPD) 102和适配集合104、120。 In the example of FIG. 2, the multimedia content 100 includes a media presentation description (MPD) 102 and 104, 120 adapted to set. 适配集合104、120包括相应的多个表示。 Adapter set 104, 120 includes a respective plurality of FIG. 在该示例中，适配集合104包括表示106A、106B等(表示106)，而适配集合120包括表示122A、122B等(表示122)。 In this example, the adapter 104 comprises a set of expressed 106A, 106B and the like (represented by 106), is adapted in set 120 includes a representation 122A, 122B and the like (represented by 122). 表示106A包括可选的报头数据110和片段112々至112叫片段112)，而表示1068包括可选的报头数据114和片段1164至116_片段116)。 It denotes 106A includes an optional header 110 and data fragments called fragment 112々 112 to 112), and includes an optional 1068 indicates header data segments 114 and segments 116 1164 to 116_). 同样，表示122包括相应的可选的报头数据124、128。 Similarly, 122 include respective represents an optional header data 124,128. 表示1224包括片段126六至1261(片段126)，而表示1228包括片段130A至130M(片段130)。 1224 indicates a fragment comprising 126 6-1261 (segment 126), and 1228 indicates a fragment including 130A-130M (segment 130). 为了方便起见，字母N被用于指定表示106中的每个表示中的最后的片段。 For convenience, the letter N is used to specify the last segment 106 of each representation in FIG. 字母M被用于指定表示122中的每个表示中的最后的片段。 The letter M is used to specify the last segment 122 of each representation in FIG. M和N可以具有不同的值或者相同的值。 M and N may have different values ​​or the same value.
[0078]片段112、116被示出为具有相同的长度，以指示相同的适配集合的片段可以时间上对齐。 [0078] The fragments 112 and 116 are shown as having the same length, adapted to indicate the same set of fragments can be aligned in time. 相似地，片段126、130被示出为具有相同的长度。 Similarly, segments 126, 130 are shown as having the same length. 然而，片段112、116具有与片段126、130不同的长度，以指示不同的适配集合的片段不一定在时间上对齐。 However, segments 112, 116 having different lengths fragments of 126, 130, adapted to indicate a different set of segments are not necessarily aligned in time.
[0079] MPD 102可以包括与表示106分离的数据结构。 [0079] MPD 102 may include data structures 106 representing separate. MPD 102可以对应于图1的清单文件66 ο同样地，表示106对应于图1的表示68 ο总体上，MPD102可以包括概括地描述表示106的特性(例如，编码和渲染特性、适配集合、MPD 1 2对应的轮廓、文本类型信息、照相机角度信息、评级信息、技巧模式信息(例如，表明包括时间子序列的表示的信息)和/或用于取回远程时段的信息(例如，用于在播放期间插入到媒体内容中的目标广告))的数据。 MPD 102 may correspond to a list of documents 66 ο Similarly, 106 corresponds to the showing of FIG. 1 showing generally, MPD 102 may include broadly described 68 ο a characteristic 106 (e.g., encoding and rendering characteristic, adaptation set, MPD 1 2 corresponding to the outline, text type information, camera angle information, rating information, trick mode information (e.g., show that includes a representation of the time sequence information) and / or information for retrieving the remote period (e.g., for during playback inserted into the target advertising media content)) data.
[0080]当存在时，报头数据110可以描述片段112的特性，例如，随机访问点的时间位置、片段112中的哪个片段包括随机访问点、在片段112内与随机访问点的字节偏移、片段112的统一资源定位符(URL)或者片段112的其它方面。 [0080] When present, the header data 110 may describe the characteristics of fragment 112, for example, the time position of the random access point, which fragment comprises the fragment of a random access point 112, the byte offset from the random access points within the segment 112 , a uniform resource locator (URL) or a fragment of a fragment of 112 112 otherwise. 当存在时，报头数据114可以描述片段116的相似的特性。 When present, the header 114 may describe the data segments 116 of similar characteristics. 相似地，报头数据124可以描述片段126的特性，而报头数据128可以描述片段130的特性。 Similarly, the header 124 may describe the characteristics of the data segment 126, and the header data 128 may describe the characteristics of fragment 130. 额外地或者替代地，这样的特性可以完全地被包括在MPD 102内。 Additionally or alternatively, such characteristics can be completely included in the MPD 102.
[0081]片段(例如，片段112)包括一个或多个经编码的视频样本，其中每个样本包括视频数据的帧或者截片。 [0081] fragments (e.g., fragments 112) comprises one or more encoded video samples, wherein each sample comprises a video data frame or a cut sheet. 对于包括视频数据的片段来说，经编码的视频样本中的每个样本都可以具有相似的特性，例如，高度、宽度、以及带宽要求。 For fragments include video data, the encoded video samples in each sample may have similar characteristics, e.g., height, width, and bandwidth requirements. 尽管没有在图2的示例中示出这样的数据，但是这样的特性可以由MPD 102的数据来描述。 Although not shown in the example such data in FIG. 2, but such characteristics may be described by the MPD 102 data. 在加入在本公开内容中所描述的用信号发送的信息中的任何或全部信息的情况下，MPD 102可以包括由3GPP规范来描述的特性。 Or the case where all information is added as described in the present disclosure is signaled in any information, MPD 102 may comprise characteristics described in the 3GPP specifications.
[0082]片段112、116中的每个片段都可以与唯一的统一资源标识符(URI)(例如，统一资源定位符(URL))相关联。 [0082] Each fragment of the 112, 116 may be associated with a unique uniform resource identifier (the URI) (e.g., a uniform resource locator (URL)). 因此，片段112、116中的每个片段可以是使用流传输网络协议(例如，DASH)独立地可取回的。 Thus, each fragment of 112, 116 may be used in a streaming network protocol (e.g., the DASH) independently retrievable. 以这种方式，目标设备(例如，客户端设备40)可以使用HTTP GET请求以取回片段112或者124。 In this manner, the target device (e.g., client device 40) may use an HTTP GET request to retrieve fragments of 112 or 124. 在一些示例中，客户端设备40可以使用HTTP部分GET请求来取回片段112者或124的具体的字节范围。 In some examples, client device 40 may use the HTTP GET request to retrieve the clip portion 112 or 124 of a particular byte range.
[0083]根据本公开内容的技术，两个或多个适配集合可以包括相同类型的媒体内容。 [0083] The techniques of this disclosure, a set of two or more adaptation may include the same type of media content. 然而，适配集合的实际媒体可以不同。 However, the actual collection of media adaptation may be different. 例如，适配集合104、120可以包括音频数据。 For example, the adapter 104, 120 may include a set of audio data. 也就是说，片段112、116、126、130可以包括经编码的音频数据的数据表示。 That is, segments 112,116,126,130 may include data encoded audio data of FIG. 然而，适配集合104可以对应于英语语言的音频数据，而适配集合120可以对应于西班牙语语言的音频数据。 However, the adapter 104 can be set corresponding to the audio data of the English language, while adapting the set of audio data may correspond to a Spanish language 120. 作为另一个示例，适配集合104、102可以包括经编码的视频数据的数据表示，但是适配集合104可以对应于第一照相机角度，而适配集合120可以对应于第二、不同的照相机角度。 As another example, the adapter may include a collection of 104,102 encoded video data via a data representation, but adapted to the first set 104 may correspond to the angle of the camera, and the adaptation set 120 may correspond to a second, different camera angles . 作为又一个示例，适配集合104、120可以包括定时文本(例如，用于字幕)的数据表示，但是适配集合104可以包括英语语言的定时文本，而适配集合120可以包括西班牙语语言的定时文本。 As yet another example, the adapter 104, 120 may include a set of timed text (e.g., subtitle) representation of data, but the adaptation set 104 may include timing the English language text, and the adaptation set 120 may include a Spanish language timed text. 当然，仅仅作为示例提供了英语和西班牙语;通常，任何语言都可以包括在适配集合中，包括音频和/或定时文本，并且可以提供两个或多个替代的适配集合。 Of course, only provided as an example of English and Spanish; generally, any language can be included in the adaptation set, including audio and / or timed text, and may provide a set of two or more alternative adaptation.
[0084]根据本公开内容的技术，用户可以初始地选择适配集合104。 [0084] The techniques of this disclosure, the user may initially select matched set 104. 替代地，客户端设备40可以基于例如配置数据(例如，默认用户偏好)来选择适配集合104。 Alternatively, the client device 40 may be based on configuration data (e.g., user preference default) adapted to select a set 104. 无论如何，客户端设备40可以初始地从适配集合104的表示106中的一个表示取回数据。 In any case, client device 40 may initially set 104 from a representation of the adapter 106 indicates the retrieved data. 特别地，客户端设备40可以提交请求以从表示106中的一个表示的一个或多个片段取回数据。 In particular, the client device 40 may submit a request to the one or more segments of one represents 106 from retrieve data representation. 例如，假设可用的网络带宽的量最佳地对应于表示106A的比特速率，客户端设备40可以从片段112中的一个或多个片段取回数据。 For example, assume that the available network bandwidth in an amount corresponding to the best 106A represents the bit rate, the client device 40 may retrieve data from a plurality of segments 112 or segments. 响应于带宽波动，客户端设备40可以切换到表示106中的另一个表示，例如，表示106B。 Fluctuations in response to the bandwidth, the client device 40 may switch to another represent 106 represents, for example, expressed 106B. 也就是说，在可用的网络带宽的增加或者降低之后，客户端设备40可以开始利用带宽适配技术来从片段116中的一个或多个片段取回数据。 That is, after increasing the available network bandwidth, or reduced, the client device 40 may start using a bandwidth adaptation technique to retrieve data from a plurality of segments 116 or segments.
[0085]假设表示106A是当前的表示，并且客户端设备40从表示106A的起点处开始，客户端设备40可以提交一个或多个请求以取回片段112A的数据。 [0085] The current hypothesis 106A represents representation, and the client device 40 indicates the start from the starting point 106A, the client device 40 may submit one or more requests to retrieve the data segment 112A. 例如，客户端设备40可以提交HTTP GET请求以取回片段112A，或者提交若干个HTTP部分GET请求以取回片段112A的连续部分。 For example, the client device 40 may submit an HTTP GET request to retrieve segments 112A, or submit a number of HTTP GET request to retrieve portions of the continuous fragment of the portion 112A. 在提交一个或多个请求以取回片段112A的数据之后，客户端设备40可以提交一个或多个请求以取回片段112B的数据。 After submission of a request to retrieve one or more data segments 112A, the client device 40 may submit one or more requests to retrieve the data segment 112B. 特别地，客户端设备40可以积累表示106A的数据，在该示例中，直到已经缓冲了允许客户端设备40开始对缓冲器中的数据进行译码和呈现的足够量的数据为止。 In particular, the client device 40 may accumulate data representing 106A is, in this example, until it has buffered up a sufficient amount of the data allows the client device 40 to start the data buffer for decoding and rendering.
[0086]如在上文中所讨论的，客户端设备40可以周期性地确定网络带宽的可用的量，并且如果需要的话，在适配集合104的表示106之间执行带宽适配。 , The client device 40 may periodically determine the amount of network bandwidth [0086] As discussed above may be used, and if desired, that the implementation of the adaptation set 104 106. bandwidth adaptation. 通常，这样的带宽适配是简化的，这是因为表示106的片段是时间上对齐。 Typically, this bandwidth adaptation is simplified because the segments 106 are aligned represents the time. 例如，片段112A和片段116A包括在相同的相对播放时间开始和结束的数据。 For example, segments 112A and 116A fragment including the start and end of data in the same relative playing time. 因此，响应于可用的网络带宽中的波动，客户端40可以在片段边界处在表示106之间进行切换。 Thus, in response to the available network bandwidth fluctuations, the client 40 may be located in the segment 106 to switch between boundary representation.
[0087]根据本公开内容的技术，客户端设备40可以接收请求以切换适配集合，例如，从适配集合104到适配集合120。 [0087] The technology may be received, the client device 40 of the present disclosure is adapted to set handover request, e.g., from a set of adapter 104 to the adapter 120 set. 例如，如果适配集合104包括英语的音频或者定时文本数据，并且适配集合120包括西班牙语的音频或者定时文本，在用户确定在特定的时间西班牙语比英语更优选之后，客户端设备40可以接收来自用户的请求以从适配集合104切换到适配集合120。 For example, if the adapter 104 comprises a set of timed text or audio data of English, Spanish and adapted set 120 comprises a timed text or audio, and more preferably after the user is determined at a particular time Spanish than English, the client device 40 may receiving a request from a user to a set of adapter 104 from switching to the matching set 120. 作为另一个示例，如果适配集合104包括来自第一照相机角度的视频数据，并且适配集合120包括来自第二、不同的照相机角度的视频数据，在用户确定在特定的时间第二照相机角度比第一照相机角度更优选之后，客户端设备40可以接收来自用户的请求以从适配集合104切换到适配集合120。 As another example, if the adapter 104 comprises a set of video data from a first camera angle and adapted to be set from 120 comprises a second, different camera angles of video data, the user is determined at a particular time than a second camera angle after the first camera angle and more preferably, the client device 40 may receive a request from a user to a set of adapter 104 from switching to the matching set 120.
[0088] 为了实现从适配集合104到适配集合120的切换，客户端设备40可以参考MPD 102的数据。 [0088] In order to achieve the set 104 is adapted to switch the adapter, the client device 40 may be a set of reference data 120 of the MPD 102. MPD 102的数据可以指示表示122的片段的开始和结束播放的时间。 Data represent MPD 102 may indicate the start and end time played segment 122. 客户端设备40可以确定接收到在适配集合之间切换的请求的播放时间，并且将该所确定的播放时间与适配集合120的下一个切换点的播放时间进行对比。 The client device 40 may determine the playback time of receiving the request for switching between the adaptation set, and the playback time of the determined playback time to the next switching point 120 and adapted to compare set. 如果下一个切换点的播放时间足够接近所确定的接收到切换请求的播放时间，客户端设备40可以确定网络带宽的可用的量，并且选择表示122中的具有由可用的网络带宽的量支持的比特速率的一个表示，则请求表示122中的所选择的一个包括切换点的表示的数据。 If the next playback time point of switching the amount of available receiving the playback time of the switching request, the client device 40 may determine the network bandwidth determined close enough, and selects represents 122 has a support from the amount of available network bandwidth of represents a bit rate, the request 122 indicates the selected data representing a handover point comprises.
[0089]例如，假设客户端设备40接收请求以在片段112B的播放期间在适配集合104和120之间进行切换。 [0089] For example, assume that the client device 40 receives a request to switch between the adapter 120 and set 104 during playback of the segment 112B. 客户端设备40可以确定在表示122A中紧跟着片段126B的片段126C包括在片段126C的开始处(在瞬时播放时间方面)的切换点。 The client device 40 may determine the represented 122A 126C followed by the beginning of the switching point (instantaneous playback time) 126B includes a fragment of the fragment of 126C. 特别地，客户端设备40可以根据MPD 102的数据确定片段126C的切换点的播放时间。 In particular, the client device 40 may determine the playback time of the switching point of the data segment 126C of the MPD 102. 此外，客户端设备40可以确定片段126C的切换点在接收到在适配集合之间切换的请求的播放时间之后。 Further, 40 can be determined switching point segment 126C client device receiving the playing time between adaptation set after handover request. 此外，客户端设备40可以确定表示122A具有最合适于所确定的网络带宽的量的比特速率(例如，高于适配集合120中的所有其它表示122的比特速率，而不超过所确定的可用的网络带宽的量)。 Further, the client device 40 may determine an amount of 122A represent the bit rate with the most suitable to the determined network bandwidth (e.g., higher than the set of all other adaptation rate of 120 bits representing 122, without exceeding the determined available the amount of network bandwidth).
[0090]在上文所描述的示例中，客户端设备40可以具有适配集合104的表示106A的片段112B的经缓冲的数据。 [0090] In the example described above, the client device 40 may have buffered data segments 106A and 112B set 104 represents the adaptation. 然而，根据在适配集合之间进行切换的请求，客户端设备40可以请求片段126C的数据。 However, according to a request for switching between the adaptation set, the client device 40 may request the data segment 126C. 客户端设备40可以大体上与取回片段126C的数据同时取回片段112B的数据。 The client device 40 may be substantially the retrieved data segment 126C while retrieving the data segment 112B. 也就是说，如在图2的示例中所示的，因为在播放时间方面片段112B和片段126C交迭，所以在大体上与取回片段112B的数据相同的时间取回片段126C的数据能是必要的。 That is, as shown in the example of FIG. 2, since the playback time segments 112B and 126C overlapping fragments, the fragments 126C retrieved data retrieved in the data segment 112B substantially the same time as the energy is necessary. 因此，取回数据以用于在适配集合之间切换可以不同于取回数据以用于在相同的适配集合的两个表示之间切换，至少是因为不同的适配集合的两个片段的数据可以大体上同时被取回，而不是按顺序地被取回(如在相同的适配集合的表示之间进行切换例如以用于带宽适应的情况)。 Thus, to retrieve data for switching may be different between the set of adaptation data retrieved for switching between two represent the same set of adaptation, because at least two segments adapted to different sets of the data may be retrieved substantially simultaneously, rather than sequentially retrieved (e.g., in between represent the same set of switches adapted for example in the case of the bandwidth adaptation).
[0091]图3是示出了示例视频文件150的要素的框图，所述示例视频文件150可以对应于表示的片段(例如，图2的片段112、124中的一个片段)。 [0091] FIG. 3 is a block diagram illustrating exemplary components of a video file 150, the example video file 150 may correspond to fragments (e.g., fragments of a segment 112, 124 of FIG. 2) is represented as a. 片段112、116、126、130中的每个片段可以包括大体上与在图3的示例中所示出的数据的布置一致的数据。 Each fragment of 112,116,126,130 may include substantially identical data with the data shown in the example of FIG. 3 arrangement. 如上文所述，根据ISO基础媒体文件格式及其扩展的视频文件将数据存储在被称为“盒子(box)”的一系列的对象中。 A set of objects described above, according to the ISO base media file format and the expanded video data is stored in files called "box (Box)" in. 在图3的示例中，视频文件150包括文件类型(FTYP)盒子152、电影(MOOV)盒子154、电影片段162(还被称为电影片段盒子(MOOF))以及电影片段随机访问(MFRA)盒子164。 In the example of Figure 3, the video file 150 includes a file type (ftyp) box 152, the film (the MOOV) box 154, movie fragments 162 (also referred to as movie fragment box (a MOOF)) and random access movie fragment (The MFRA) box 164.
[0092]视频文件150通常表示多媒体内容的片段的示例，所述多媒体内容的片段可以被包括在表示106、122(图2)中的一个表示中。 [0092] Video files 150 generally indicates an example of a fragment of multimedia content, the multimedia content segments may be expressed include one shown in 106, 122 (FIG. 2),. 以这种方式，视频文件150可以对应于片段112中的一个片段、片段116中的一个片段、片段126中的一个片段、片段130中的一个片段或者另一个表不的片段。 In this manner, the video file 150 in segment 112 may correspond to a fragment, a fragment of 116, a fragment of 126, 130 in a fragment of another table or not the fragment.
[0093] 在图3的示例中，视频文件150包括一个片段索引(SIDX)盒子161。 [0093] In the example of FIG. 3, a video file includes a segment index 150 (the SIDX) box 161. 在一些示例中，视频文件150可以在例如电影片段162之间包括额外的SIDX盒子。 In some examples, the video file 150 may include additional SIDX in box 162, for example, between the movie fragments. 通常，SIDX盒子(例如，SIDX盒子161)包括描述电影片段162中的一个或多个片段的字节范围的信息。 Typically, SIDX box (e.g., SIDX box 161) includes information describing a movie fragments byte ranges of 162 or more segments. 在其它示例中，可以在MOOV盒子154内、在MOOV盒子154之后、在MFRA盒子164之前或之后或者在视频文件150内的其它地方提供SIDX盒子161和/或其它SIDX盒子。 In other examples, it may be in the MOOV box 154, after the MOOV box 154, box 164, or before or after MFRA provide SIDX box 161 and / or other SIDX elsewhere within the box 150 the video file.
[0094] 文件类型(FTYP)盒子152通常描述视频文件150的文件类型。 [0094] The file type (ftyp) box 152 is generally described 150 types of video files. 文件类型盒子152可以包括标识了描述视频文件150的最佳使用的规范的数据。 File type box 152 may include data identifying the specifications described in the best use of the video file 150. 可以将文件类型盒子152置于MOOV盒子154、电影片段盒子162、和MFRA盒子164之前。 File type box 152 may be placed MOOV box 154, movie fragments box 162, box 164 and before MFRA.
[0095] 在图3的示例中，MOOV盒子154包括电影报头(MVHD)盒子156、轨道(TRAK)盒子158以及一个或多个电影扩展(MVEX)盒子160。 [0095] In the example of FIG. 3, the MOOV box 154 includes a movie header (mvhd) box 156, the track (TRAK) box 158 and one or more extended movie (an MVEX) box 160. 通常，MVHD盒子156可以描述视频文件150的一般特性。 Typically, MVHD box 156 may describe the general characteristics of the video file 150. 例如，MVHD盒子156可以包括描述了何时视频文件150被最初创建、何时视频文件150最后被修改、视频文件150的时间标尺、视频文件150的播放的持续时间或者总体上描述视频文件150的其它数据的数据。 For example, MVHD box 156 may include a description of the video file when it is initially created 150, 150 when a video file was last modified, the video file time scale of 150, the duration of the video file to play 150 or general description of the video file 150 data other data.
[0096] TRAK盒子158可以包括视频文件150的轨道的数据。 [0096] TRAK box 158 may include a video file data track 150. TRAK盒子158可以包括描述了对应于TRAK盒子158的轨道的特性的轨道报头(TKHD)盒子。 TRAK box 158 may include a description of the characteristics TRAK box 158 corresponding to the tracks of the track header (tkhd) box. 在一些示例中，TRAK盒子158可以包括经编码的视频图片，而在其它的示例中，可以将轨道的经编码的视频图片包括在电影片段162中，TRAK盒子158的数据可以引用所述电影片段162。 In some examples, TRAK box 158 may include coded video pictures, while in other examples, the encoded video image track 162 includes segments in the film, the movie fragment may reference data TRAK box 158 162.
[0097]在一些示例中，视频文件150可以包括多于一个的轨道，尽管对于DASH协议工作来说这不是必须的。 [0097] In some examples, the video file 150 may include more than one track, although DASH protocol for this is not essential for working. 因此，MOOV盒子154可以包括等于视频文件150中的轨道的数量的TRAK盒子数量。 Thus, MOOV box 154 may include a TRAK box number is equal to the number of the video file 150 tracks. TRAK盒子158可以描述对应的视频文件150的轨道的特性。 TRAK box 158 may describe the characteristics of the track 150 corresponding to the video file. 例如，TRAK盒子158可以描述对应的轨道的时间和/或空间信息。 For example, TRAK box 158 may describe a track corresponding to the time and / or spatial information. 当封装单元30(图1)将参数集合轨道包括在视频文件(例如视频文件150)中时，与MOOV盒子154的TRAK盒子158相似的盒子可以描述参数集合轨道的特性。 When the packaging unit 30 (FIG. 1) parameter set included in the video track files (e.g. video file 150), the MOOV box TRAK box 154 box 158 may describe a similar set of parameters characteristic of the track. 封装单元30可以在描述参数集合轨道的TRAK盒子内，用信号发送参数集合轨道中的序列级别SEI消息的存在。 Encapsulation unit 30 may be set within the track box TRAK in the description parameters, the presence of sequence level SEI message track signaled parameter set.
[0098] MVEX盒子160可以描述对应的电影片段162的特性，例如以用信号通知除了包括在MOOV盒子154内的视频数据(如果有的化)之外，视频文件150包括电影片段162。 [0098] MVEX box 160 may describe characteristics of the corresponding movie clips 162, for example, in addition to video data included in the MOOV box 154 (if any technology), the video file 150 includes 162 signals the movie fragments. 在流传输视频数据的上下文中，经编码的视频图片可以被包括在电影片段162中，而不是在MOOV盒子154中。 In the context of streaming video data, encoded video pictures may be included in the movie fragments 162, rather than the MOOV box 154. 因而，可以将所有的经编码的视频样本包括在电影片段162中，而不是在MOOV盒子154 中。 Accordingly, all the encoded video may be included in the sample 162 in the movie fragments, rather than MOOV box 154.
[0099] MOOV盒子154可以包括MVEX盒子160的数量，所述MVEX盒子160的数量等于视频文件150中的电影片段162的数量。 [0099] MOOV box 154 may include the number MVEX cassette 160, the number 160 is equal to the video cassette file MVEX movie fragments number 162 150. MVEX盒子160中的每个MVEX盒子都可以描述电影片段162中的对应的一个电影片段的特性。 MVEX MVEX each cassette box 160 may characterize a movie fragment movie clips 162 corresponding. 例如，每个MVEX盒子可以包括电影扩展报头盒子(MEHD)盒子，其描述了电影片段162中的对应的一个电影片段的瞬时的持续时间。 For example, each cartridge may include movies MVEX extension header box (MEHD) box, which describes the instantaneous duration of a movie fragment movie clips 162 corresponding.
[0100]如上所述，封装单元30可以将序列数据集合存储在不包括实际的经编码的视频数据的视频样本中。 [0100] As described above, the packaging unit 30 may sample the video sequence stored in the data set does not include the actual encoded video data. 视频样本可以大体上对应于在具体的时间实例中是经编码的图片的表示的访问单元。 Video samples may generally correspond to the access unit at a particular time is represented by the examples of encoded pictures. 在AVC上下文中，经编码的图片包括一个或多个VCL NAL单元，其包括用于构造访问单元和其它相关联的非VCL NAL单元的所有像素的信息，例如，SEI消息。 In the context of AVC, the encoded image comprises one or more VCL NAL units, which comprises a non-VCL NAL units and other means configured to access information associated with all pixels, e.g., the SEI message. 因此，封装单元30可以在在电影片段162中的一个电影片段中包括序列数据集合，所述序列数据集合可以包括序列级别SEI消息。 Accordingly, the encapsulation unit 30 may include a set of data sequences, the sequence data set may include a sequence level SEI message fragment movie in a movie fragment 162. 封装单元30可以进一步将序列数据集合和/或序列级别SEI消息的存在用信号发送为存在于对应于电影片段162中的一个片段的MVEX盒子160中的一个MVEX盒子内的电影片段162中的一个电影片段中。 Movie fragments 162 within MVEX cassette 160 encapsulation unit 30 may further sequence data set and / or the presence sequence level SEI message is signaled to be present in the corresponding movie fragments 162 of a fragment of a MVEX box one movie clips.
[0101]电影片段162可以包括一个或多个经编码的视频图片。 [0101] movie fragments 162 may include one or more coded video pictures. 在一些示例中，电影片段162可以包括一个或多个图片的组(GOP)，其中每个组可以包括多个经编码的视频图片，例如，帧或者图片。 In some examples, the movie fragments 162 may include one or more groups of pictures (the GOP), where each group may include a plurality of encoded video image, e.g., a frame or a picture. 此外，如上文所描述的，在一些示例中，电影片段162可以包括序列数据集合。 In addition, as hereinbefore described, in some examples, movie fragments 162 may include sequence data set. 电影片段162中的每个电影片段可以包括电影片段报头盒子(MFHD，未在图3中示出)。 Each movie fragment movie fragments 162 may include a movie fragment header box (MFHD, not shown in FIG. 3). MFHD盒子可以描述对应的电影片段的特性，例如，电影片段的序列数。 MFHD box may describe characteristics of the corresponding movie fragments, e.g., the sequence number of movie fragments. 电影片段162可以被包括在视频文件150中的序列数的次序中。 Movie fragments 162 may be include a sequence number in the order of the video file 150.
[0102] MFRA盒子164可以描述视频文件150的电影片段162内的随机访问点。 [0102] MFRA cartridge 164 can be described as random access points within the video file of movie fragments 162,150. 这可以帮助执行技巧模式，例如，执行在视频文件150内寻找特定的时间位置。 This can help perform tricks mode, for example, the implementation of looking for a specific time position within the video file 150. 在一些示例中，MFRA盒子164通常是可选的，并且不需要被包括在视频文件中。 In some examples, The MFRA box 164 is usually optional, and need not be included in the video file. 同样，客户端设备(例如，客户端设备40)不一定需要引用MFRA盒子164以正确地将视频文件150的视频数据译码和显示。 Similarly, the client device (e.g., client device 40) does not necessarily need to reference MFRA box 164 to correctly decode the video data file 150 and the video display. MFRA盒子164可以包括轨道片段随机访问(TFRA)盒子(未示出)的数量，其等于视频文件150的轨道的数量，或者在一些示例中，等于视频文件150的媒体轨道(例如，非提示轨道)的数量。 MFRA cartridge 164 may include a track fragment random access (TFRA) box (not shown) the number of which is equal to the number of tracks of the video file 150, or in some examples, is equal to a video file media track 150 (e.g., non-hint tracks )quantity.
[0103]图4A和图4B是示出了根据本公开内容的技术的用于在播放期间在适配集合之间进行切换的示例方法的流程图。 [0103] FIGS 4A and 4B are a flowchart illustrating an example method of switching between the adapter set according to the techniques of the present disclosure are used during playback. 关于服务器设备60(图1)和客户端设备40(图1)描述了图4A和图4B的方法。 About server device 60 (FIG. 1) and the client device 40 (FIG. 1) describes a method of FIGS. 4A and 4B. 然而，应当理解的是，可以配置其它的设备以执行相似的技术。 However, it should be appreciated that other devices may be configured to perform similar techniques. 例如，在一些示例中，客户端设备40可以从内容准备设备20取回数据。 For example, in some examples, client device 40 may retrieve the data from the device 20 to prepare the contents.
[0104]在图4A的示例中，最初，服务器设备60向客户端设备40提供适配集合的指示和适配集合的表示(200)。 [0104] In the example of FIG 4A, initially, the server device 60 and provide an indication representing (200) adapted to set a set of adaptation to the client device 40. 例如，服务器设备60可以向客户端设备40发送用于清单文件(例如，MPD)的数据。 For example, the server device 60 may transmit to the client device 40 for a list of files (e.g., the MPD) data. 尽管未在图4A中示出，服务器设备60可以响应于来自客户端设备40的对指示的请求来向客户端设备40发送指示。 Although not shown in FIG. 4A, the server device 60 may be transmitted in response to the client device 40 a request for an indication from the client device 40 an indication. 指示(例如，包括在清单文件内)可以额外地包括限定了表示内的片段的开始和结束的播放时间以及片段内的各种类型的数据的字节范围的数据。 Indication (e.g., included in the manifest file) may additionally comprise data defining the start and end of a byte range within a segment playing time, and various types of data within the segment representation. 特别地，指示可以指示出包括在适配集合中的每个适配集合内的数据的类型，以及该数据的类型的特性。 In particular, the indication may comprise data indicating that the adaptation of each set of the type adapted to set, and the type of the data characteristics. 例如，对于包括视频数据的适配集合，指示可以限定包括在视频适配集合中的每个视频适配集合内的视频数据的照相机角度。 For example, for adapting a set of data including video, camera angle indication may include video data is defined within each set of video adapter video adaptation set. 作为另一个示例，对于包括音频数据和/或定时文本数据的适配集合，指示可以限定音频和/或定时文本数据的语言。 As another example, for including audio data and / or adaptation set, an audio indication may define the language and / or text data timing of the timing of the text data.
[0105]客户端设备40从服务器设备60接收适配集合和表示指示(202)。 [0105] The client device 40 receives from the server device 60 and represents a set of adaptation indicator (202). 客户端设备40可以配置为具有针对例如语言偏好和/或照相机角度偏好中的任何或所有项的用户默认偏好。 The client device 40 may be configured with a default language preference for any preferences and / or preferences of camera angles or all of the user, for example. 因此，客户设备40可以基于用户偏好而选择各种类型的媒体数据的适配集合(204)。 Thus, the client device 40 may be adapted to select the set of (204) the various types of media data based on user preferences. 例如，如果用户已经选择了语言偏好，则客户端设备40可以至少部分基于语言偏好(以及其它特性，例如，客户端设备40的译码和渲染能力以及适配集合的编码和渲染特性)来选择音频适配集合。 For example, if the user has selected a language preference, the client device 40 may be at least partially based on the language preference (as well as other characteristics, e.g., client device rendering capabilities of decoding and encoding 40 and adapted to set and rendering characteristic) selected The audio adapter sets. 客户端设备40可以针对音频和视频数据两者(并且，如果用户已经选定显示字幕的话，针对定时文本)来相似地选择适配集合。 The client device 40 may be for both audio and video data (and, if the user has selected, then display the subtitles, the timing for the text) is adapted to select the set similarly. 替代地，客户端设备40不是使用用户偏好，而是可以接收初始的用户选择或者默认配置来选择适配集合。 Alternatively, the client device 40 instead of using the user preferences, but may receive an initial user selection or the default configuration is adapted to select a set.
[0106]在选择了特定的适配集合之后，客户端设备40可以确定网络带宽的可用的量(206)，以及适配集合中的表示的比特速率(208)。 [0106] After the selection of a particular set of adapter 40 may determine the amount of network bandwidth available to a client device (206), and the bit rate adaptation set represented by (208). 例如，客户端设备40可以参考媒体内容的清单文件，其中，清单文件可以限定表示的比特速率。 For example, the client device 40 can refer to the media content file list, wherein the manifest file may define a bit rate representation. 然后，客户端设备40可以例如基于适配集合的表示的比特速率以及基于所确定的可用的网络带宽的量来从适配集合中选择表示(210)。 Then, the client device 40 may represent, for example, based on the bit rate adaptation set, and the amount of available network bandwidth is selected based on the determined representation (210) from the adaptation set. 例如，客户端设备40可以选择具有不超过可用的网络带宽的量的适配集合的最高比特速率的表示。 For example, the client device 40 may select the highest bit rate adaptation set having no more than the available bandwidth of the network representation.
[0107]客户端设备40可以相似地从所选择的适配集合中的每个适配集合选择表示(其中，所选择的适配集合可以各自对应于不同类型的媒体数据，例如，音频、视频和/或定时文本)。 [0107] The client device 40 may be similarly adapted from the selected set for each adaptation set selection (wherein, the selected adaptation set may each correspond to a different type of media data, e.g., audio, video and / or timed text). 应当理解的是，在一些实例中，可以针对相同类型的媒体数据选择多个适配集合，例如，针对立体声或者多视图的视频数据、用于支持各种级别的环绕声或者三维音频阵列的多个音频通道等。 It will be appreciated that, in some instances, may be adapted to select a plurality of types of media for the same set of data, e.g., for a stereo or multi-view video data for multiple levels of support various audio surround sound or three-dimensional array audio channels and so on. 客户端设备40可以针对将要呈现的每个类型的媒体数据而选择至少一个适配集合，并且从每个所选择的适配集合选择一个表示。 The client device 40 may be adapted to select at least one set of data for each type of media to be presented, and represent a selection from a set of each of the selected adaptation.
[0108]然后，客户端设备40可以请求所选择的表示的数据(212)。 Data [0108] The client device 40 may request the selected representation (212). 例如，客户端设备40可以使用例如HTTP GET或者部分GET请求来请求来自所选择的表示中的每个表示的片段。 For example, the client device 40 may be used, for example, HTTP GET request or a partial GET request represents a fragment represented by each selected from the. 通常，客户端设备40可以请求来自具有大体上同时的播放时间的表示中的每个表示的片段的数据。 Typically, the client device 40 may request from the data representing substantially simultaneously with the playback time of each segment representation. 作为响应，服务器设备60可以向客户端设备40发送所请求的数据(214)。 In response, the data server device 60 may transmit to the client device 40 requested (214). 客户端设备40可以对所接收的数据进行缓冲、译码、和呈现(216)。 The client device 40 may buffer the received data, decoding, and rendering (216).
[0109]随后，客户端设备40可以接收针对不同的适配集合的请求(220)。 [0109] Subsequently, the client device 40 may receive a request (220) a different set of adaptation. 例如，用户可以选定切换到音频或者定时文本数据的不同语言、或者不同的照相机角度，例如，以增加或者降低3D视频呈现的深度，或者针对2D视频呈现从替代的角度观看视频。 For example, a user may select to switch to a different language audio or timed text data, or a different camera angle, e.g., to increase or reduce the depth of the 3D video presentation, presentation or view a video from the perspective of an alternative for the 2D video. 当然，如果替代的观看角度提供3D视频呈现的话，则客户端设备40可以切换例如两个或更多个视频适配集合以提供从替代的观看角度的3D演示。 Of course, if the alternative viewing angle to provide a 3D video presentation, then the client device 40 can be switched, for example, two or more video set adapted to provide a 3D representation of the alternative viewing angles.
[0110]无论如何，在接收不同的适配集合的请求之后，客户端设备40可以基于请求选择适配集合(222)。 [0110] In any case, after receiving a request to set a different adapter, the client device 40 may be adapted to select a request based on the set of (222). 该选择过程可以大体上与关于上面的步骤204来描述的选择过程相似。 This selection process may be substantially similar to the above selecting step 204 on to describe the process. 例如，客户端设备40可以选择新的适配集合，以使得新的适配集合包括符合由用户请求的特性(例如，语言或者照相机角度)以及客户端设备40的编码和渲染能力的数据。 For example, the client device 40 may be adapted to select a new set, so that a new set of adaptation data comprises encoding and rendering capabilities in line with the characteristics requested by the user (e.g., language or a camera angle) and the client device 40. 客户端设备40还可以确定网络带宽的可用的量(224)，确定新的适配集合中的表示的比特速率(226)，以及基于表示的比特速率和网络带宽的可用的量而从新的适配集合选择表示(228)。 40 further client device may determine the amount of bandwidth available to a network (224), determine the bit rate represented by the new adapter set (226), and based on the amount of available network bandwidth and the bit rate representation from the new fitness select represented with a set of (228). 该表示选择过程可以大体上与在上文中关于步骤206至210来描述的表示选择过程一致。 This selection process may be generally represented in accordance with the above with respect to steps 206-210 described selection process is represented.
[0111]然后，客户端设备40可以请求所选择的表示的数据(230)。 Data [0111] The client device 40 may request the selected representation (230). 特别地，客户端设备40可以确定包括切换点的片段，所述切换点具有晚于并且接近于接收切换到新的适配集合的请求的播放时间的播放时间。 In particular, the client device 40 may include a determined switching point segment, the switching point and having a close later than the received time play time to switch to playback of a new set of requests of adaptation. 假设适配集合间的片段不在时间上对齐，请求新的适配集合的表示的片段的数据可以大体上与请求之前的适配集合的表示的数据同时发送。 Hypothesis data representing the fragment between the adapter set not aligned in time, adapted to request a new set of data segments may be generally represented by the adapter before the simultaneous transmission request set. 此外，客户端设备40可以继续请求来自没有被切换的其它适配集合的表示的数据。 Further, the client device may continue to request data from 40 shows another adaptation is not switched to the collection.
[0112]在一些实例中，新的适配集合的表示可能在不可接受地长的时间段(例如，几秒钟或者几分钟)中没有切换点。 [0112] In some examples, represents a new adaptation may be set (e.g., several seconds or minutes) at the switching point is not unacceptably long period of time. 在这样的情况下，客户端设备40可以选定请求包括具有早于接收切换到新的适配集合的请求的播放时间的播放时间的切换点的新的适配集合的表示的数据。 In this case, the client device 40 may include a handover request to the selected point of playing time playing time having received a request earlier than the switch to a new adaptation of the new set of data representing the set of adaptation. 通常，这将仅针对具有与视频和音频数据比相对低的比特速率的定时文本数据发生，并且因此，取回较早的切换点将不会不利地影响数据取回或者播放。 Typically, this will only text data for the timing of the video and audio data having a relatively lower than the bit rate occurs, and therefore, the earlier retrieved without adversely affecting the switching point of data retrieval or playback.
[0113]无论如何，服务器设备60可以向客户端设备40发送所请求的数据(232)，并且客户端设备40可以对所接收的数据进行译码和呈现(234)。 [0113] In any case, the data server device 60 may transmit to the client device 40 requested (232), and the client device 40 the received data can be decoded and presented (234). 具体地，客户端设备40可以缓冲所接收的包括新的适配集合的表示的切换点的数据，直到实际的播放时间满足或者超过切换点的播放时间为止。 Specifically, the data, the client device 40 may buffer the received set comprises representing the new adaptation of the switching point, until the actual playing time meets or exceeds the switching point until the time of playback. 然后，客户端设备40可以从呈现之前的适配集合的数据切换到呈现新的适配集合的数据。 Then, the client device 40 may be adapted to switch the data set prior to presentation to the presentation from the set of new data fitting. 并发地，客户端设备40可以继续对具有其它媒体类型的其它适配集合的数据进行译码和呈现。 Concurrently, the client device 40 the data collection can continue with other media adapted for other types of decoding and rendering.
[0114]应当理解的是，在选择第一适配集合的表示之后并且在接收切换到新的适配集合的请求之前，客户端设备40可以周期性地执行带宽估计，并且选择第一适配集合的不同的表示(如果需要，基于重新评估的网络带宽的量)。 [0114] It should be appreciated that after selecting the first set and adapted to represent a new request receives a handover before the adaptation set, the client device 40 may periodically perform bandwidth estimation, and selecting the first adapter different sets of representations (if necessary, re-evaluated based on network bandwidth amount). 同样，在选择了新的适配集合的表示之后，客户端设备40可以周期性地执行带宽估计，以确定最后的适配集合。 Also, after selecting a new set of adaptation representation, the client device 40 may periodically perform bandwidth estimation, to determine the final set of adaptation.
[0115]以这种方式，图4A和图4B的方法表示了包括以下操作的方法:从包括第一类型的媒体数据的第一适配集合取回媒体数据，呈现来自第一适配集合的媒体数据，响应于切换到包括第一类型的媒体数据的第二适配集合的请求:从第二适配集合取回包括第二适配集合的切换点的媒体数据，以及在实际的播出时间满足或者超过切换点的播出时间之后呈现来自第二适配集合的媒体数据。 [0115] In this manner, the method of FIGS. 4A and 4B shows the method comprising the acts of: retrieving a first type of media data includes media data from a first set of adaptation, the adaptation of the first presentation from the set of media data, in response to a request to switch to the second fitting comprises a first set of media data types of: retrieving second media data comprises fitting a second set of switch points from a set of adaptation, and the actual broadcast time meets or presenting the media data from the second set of adaptation exceeds the switching point after the broadcast time.
[0116]图5是示出了根据本公开内容的技术的用于在适配集合之间进行切换的另一个示例方法的流程图。 [0116] FIG. 5 is a flowchart illustrating another example of the method of the present disclosure, techniques for switching between a set of adaptation. 在该示例中，客户端设备40接收MPD文件(或者其它清单文件)(250)。 In this example, the client device 40 receives an MPD file (manifest file or other) (250). 然后，客户端设备40接收对第一适配集合的选择，所述第一适配集合包括特定类型(例如，音频、定时文本或者视频)的媒体数据(252)。 Then, the client device 40 receives a selection of a first set of adaptation, the first adaptation set comprises a particular type (e.g., audio, timed text or videos) media data (252). 然后，客户端设备40从第一适配集合的表示取回数据(254)，并且呈现所取回的数据中的至少一些数据(256)。 Then, from a first client device 40 is adapted to retrieve data represented by (254) set, at least some of the data and presenting (256) the retrieved data.
[0117]在播放来自第一适配集合的媒体数据的期间，客户端设备40接收对第二适配集合的选择(258)。 [0117] During playback of media data from the first set of adaptation, the client device 40 receives the selection (258) of the second set of adaptation. 因此，客户端设备40可以从第二适配集合的表示取回数据(260)，并且所取回的数据可以包括第二适配集合的表示内的切换点。 Thus, the client device 40 may be adapted to represent a second data retrieved (260), and the retrieved data may include a second switching point in representation from a set of adaptation set. 因此，客户端设备40可以继续呈现来自第一适配集合的数据，直到第二适配集合的切换点的播放时间为止(262)。 Thus, the client device 40 may continue to present data from the first set of adapter, a second adapter until the playback time of the switching point set (262). 然后，客户端设备40可以在切换点之后开始呈现第二适配集合的媒体数据。 Then, the client device 40 may be adapted to start rendering the media data of the second set after the switching point.
[0118]从而，图5的方法表示方法的示例，所述方法包括从包括第一类型的媒体数据的第一适配集合取回媒体数据，呈现来自第一适配集合的媒体数据，响应于切换到包括第一类型的媒体数据的第二适配集合的请求:从第二适配集合取回包括第二适配集合的切换点的媒体数据，并且在实际的播出时间已经满足或者超过切换点的播出时间之后呈现来自第二适配集合的媒体数据。 [0118] Thus, the method of Figure 5 shows an example of the method, the method comprising retrieving a first type of media data includes media data from a first set adapted to present the media data from the first set is adapted, in response to request to switch to the second fitting comprises a first set of media data types: retrieving a second set of media data adaptation includes a second switch adapted to set point and the actual broadcast have been met or exceeded from time presenting media data from the second adapter set broadcast time after the switching point.
[0119]在一个或多个示例中，可以在硬件、软件、固件或其任何组合中实现所描述的功能。 [0119] In one or more examples, the functions described may be implemented in hardware, software, firmware, or any combination thereof. 如果在软件中实现，功能可以作为计算机可读介质上的以及由基于硬件的处理单元执行的一个或多个指令或者代码被存储或者传输。 If implemented in software, the functions may be based on a computer and one or more instructions or code for a hardware processing unit is transmitted or stored on a medium readable. 计算机可读介质可以包括对应于有形的介质(例如，数据存储介质)的计算机可读存储介质、或者包括促进计算机程序从一个地方到另一个地方的传送(例如，根据通信协议)的任何介质的通信介质。 The computer-readable media may comprise computer corresponds to a tangible medium (e.g., data storage media) readable storage medium, or a computer program including the promotion (e.g., according to a communication protocol) from one place to another in any medium communication media. 以这种方式，计算机可读介质通常可以对应于(I)非暂时性的有形计算机可读存储介质或者(2)诸如信号或者载波的通信介质。 In this manner, computer-readable media may generally correspond to the (I) a non-transitory tangible computer-readable storage medium or (2) a communication medium such as a signal or a carrier wave. 数据存储介质可以是可以由一个或多个计算机或者一个或多个处理访问以取回用于实现本公开内容中所描述的技术的指令、代码和/或数据结构的任何可用的介质。 Data storage media can be by one or more computers or one or more processing instructions for access to retrieve the implement techniques of this disclosure as described herein, code, and / or any available media data structure. 计算机程序产品可以包括计算机可读介质。 The computer program product may comprise a computer-readable medium.
[0120]作为示例并且非限制，这样的计算机可读存储介质可以包括RAM、R0M、EEPR0M、CD-ROM或者其它光盘存储器、磁盘存储器或者其它磁存储设备、闪速存储器或者可以被用于以可以由计算机访问的指令或者数据结构的形式来存储期望的程序代码的任何其它介质。 [0120] By way of example and not limitation, such computer-readable storage media may include RAM, R0M, EEPR0M, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, flash memory, or may be used to be any other medium in the form of program code by a computer accessible instructions or data structures to store desired. 同样，可以将任何连接恰当地称为计算机可读介质。 Also, any connection is properly termed a computer-readable medium. 例如，如果利用同轴电缆、光纤光缆、双绞线、数字用户线(DSL)或者无线技术(例如，红外、无线电和微波)从网站、服务器或者其它远程源来发送指令，则同轴电缆、光纤光缆、双绞线、DSL或者无线技术(例如，红外、无线电和微波)包括在介质的定义中。 For example, if the use of a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies (e.g., infrared, radio, and microwave) to transmit commands from a website, server, or other remote source, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies (e.g., infrared, radio, and microwave) are included in the definition of medium. 然而，应当理解的是，计算机可读存储介质和数据存储介质不包括连接、载波、信号或者其它暂时性介质，但是反而针对非暂时性的有形存储介质。 However, it should be appreciated that the computer-readable storage medium and the data storage medium does not include a connector, a carrier signal or other transient media, but rather non-transitory tangible media for storage. 如本文所使用的，磁盘和光盘包括压缩盘(CD)、激光盘、光盘、数字多功能光盘(DVD)、软盘和蓝光盘，其中，磁盘通常磁性地复制数据，而光盘利用激光光学地复制数据。 As used herein Disk and disc, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce optically with lasers data. 上述的组合也应当被包括在计算机可读介质的范围内。 Combinations of the above should also be included within the scope of computer readable media.
[0121] 可以由一个或多个处理器(例如，一个或多个数字信号处理器(DSP)、通用微处理器、专用集成电路(ASIC)、现场可编程逻辑阵列(FPGA)或者其它等价的集成或者分离逻辑电路)来执行指令。 [0121] by one or more processors (e.g., one or more digital signal processors (DSP), general purpose microprocessors, application specific integrated circuit (ASIC), field programmable logic arrays (FPGA) or other equivalent integrated or discrete logic circuitry) to execute the instruction. 因此，如在本文中所使用的，术语“处理器”可以指任何前述的结构或者适用于实现本文中所描述的技术的任何其它结构。 Thus, as used herein, the term "processor" may refer to any of the foregoing structure or any other structure suitable for implementing the techniques described herein. 此外，在一些方面中，可以在被配置用于编码和译码或者被并入在组合的编解码器中的专用硬件和/或软件模块内提供在本文中所描述的功能。 Further, in some aspects, it may provide the functionality described herein in special purpose hardware and / or software modules configured for encoding and decoding, or incorporated in a combined codec is.
[0122]可以在包括无线手持装置、集成电路(IC)或者IC的集合(例如，芯片组)之类的宽泛的各种设备或者装置中实现本公开内容的技术。 [0122] may be (e.g., a chipset) wide variety of devices or equipment or the like in the techniques of this disclosure are implemented in the set comprises a wireless handheld device, an integrated circuit (IC) or IC. 在本公开内容中描述了各种部件、模块或者单元，以强调被配置为执行所公开的技术的设备的功能方面，但是不一定需要由不同的硬件单元实现。 In the present disclosure describes various components, modules or units to emphasize the function is configured to perform the techniques disclosed apparatus aspect, but not necessarily require realization by different hardware units. 相反，如上文中所描述的，结合合适的软件和/或固件的各种单元(包括如上文所描述的一个或多个处理器)可以被组合在编解码器硬件单元中，或者由相互作用的许多硬件单元来提供。 In contrast, as hereinbefore described, in conjunction with suitable software and various unit and / or firmware (including one or more processors as described hereinbefore) may be combined in a codec hardware unit, or by the interaction many hardware unit provided.
[0123]已经描述了各种示例。 [0123] Various examples have been described. 这些和其它的示例都在以下的权利要求书的范围内。 These and other examples are within the scope of the following claims.
1.一种取回媒体数据的方法，所述方法包括: 从包括第一类型的媒体数据的第一适配集合取回媒体数据； 呈现来自所述第一适配集合的媒体数据；以及响应于对于切换到包括所述第一类型的媒体数据的第二适配集合的请求: 从所述第二适配集合取回包括所述第二适配集合的切换点的媒体数据； 在实际的播出时间已经满足或者超过所述切换点的播出时间之后，呈现来自所述第二适配集合的媒体数据。 A method for retrieving media data, said method comprising: a first type of media data comprising a first set adapted to retrieve data from the media; the media presentation data from the first set of adaptation; and in response for the handover request to the second adapter comprises a first set of media data type: retrieving from said second set comprises adapting the set of points a second switch adapted media data; in the actual after the broadcast time has been met or exceeded the switching point of the broadcast time, rendering the media data from the second set of adaptation.
2.根据权利要求1所述的方法，其中，所述第一类型包括音频数据和字幕数据中的至少一项，其中，所述第一适配集合包括第一多个表示，所述第一多个表示包括使用第一语言的所述第一类型的媒体数据，以及其中，所述第二适配集合包括第二多个表示，所述第二多个表示包括使用不同于所述第一语言的第二语言的所述第一类型的媒体数据。 2. The method according to claim 1, wherein the first type comprises at least one of audio data and subtitle data, wherein the first set comprises a first plurality of fitting said first a plurality of first language representation comprises a first type of media data, and wherein said second adapter includes a second set of a plurality of said second plurality of said different from the first representation includes using the second language of the language type of the first media data.
3.根据权利要求1所述的方法，其中，所述第一类型包括视频数据，其中，所述第一适配集合包括第一多个表示，所述第一多个表示包括第一照相机角度的视频数据，以及其中，所述第二适配集合包括第二多个表示，所述第二多个表示包括不同于所述第一照相机角度的第二照相机角度的视频数据。 3. The method according to claim 1, wherein said first type comprises video data, wherein the first set comprises a first plurality of fitting said representation includes a first plurality of said first camera angle video data, and wherein said second adapter includes a second set of a plurality of said second plurality of said representation comprises a first camera angle different from the second camera angles of video data.
4.根据权利要求1所述的方法，其中，在接收到对于切换到所述第二适配集合的所述请求时，所述切换点的所述播出时间小于在接收到对于切换的所述请求时的所述实际的播出时间加上门限值。 The method according to claim 1, wherein, upon receiving the request for switching to the second set of adaptation, the switching point is smaller than the broadcast time for receiving the switched the actual time of said broadcast request time plus a threshold value.
5.根据权利要求1所述的方法，其中，在接收到对于切换到所述第二适配集合的所述请求时，所述切换点的所述播出时间大于在接收到对于切换的所述请求时的所述实际的播出时间，所述方法还包括:从所述第一适配集合和所述第二适配集合取回数据，直到从所述第二适配集合取回的媒体数据的播出时间已经满足或者超过所述实际的播出时间为止。 The method according to claim 1, wherein, upon receiving the request for switching to the second set of adaptation, the switching point is greater than the air time for receiving the switched the said request when the actual broadcast time, the method further comprising: adapting the first set and the second set is adapted to retrieve from the data until the second adapter from the retrieved set of broadcast time of the media data so far been met or exceeded the actual broadcast time.
6.根据权利要求1所述的方法，还包括: 获得针对所述第一适配集合和所述第二适配集合的清单文件；以及使用所述清单文件的数据来确定所述切换点的播出时间， 其中，取回所述媒体数据包括:至少部分基于所述切换点的所述播出时间与当接收到对于切换到所述第二适配集合的所述请求时的所述实际的播出时间的比较来取回所述媒体数据。 6. The method according to claim 1, further comprising: obtaining for the first set and the adapted second set adapted manifest file; determining data using the manifest file and the switching point broadcast time, wherein retrieving the media data comprises: at least a part of the switching point based on the broadcast time and the actual time when receiving the second request for adapting the set of switching to comparison of the broadcast time to retrieve the media data.
7.根据权利要求1所述的方法，还包括: 获得针对所述第一适配集合和所述第二适配集合的清单文件；以及使用所述清单文件的数据来确定所述切换点在所述第二适配集合的表示中的位置。 7. The method according to claim 1, further comprising: obtaining for the first set and the adapted second set adapted manifest file; determining data using the manifest file and the switching point It represents the position of the second set of adaptation.
8.根据权利要求7所述的方法，其中，所述位置至少部分地由所述第二适配集合的所述表示的片段中的起始字节来限定。 The method according to claim 7, wherein the position of the start byte segment at least partially by the second set of representation in the adaptation defined.
9.根据权利要求7所述的方法，其中，从所述第二适配集合取回所述媒体数据包括:从所述第二适配集合取回包括至少所述切换点的所述位置的所述表示的数据。 9. The method according to claim 7, wherein, from said second set adapted to retrieve the media data comprises: retrieving from said second set comprises adapting at least the position of the switching point the data representation.
10.根据权利要求7所述的方法，其中，所述表示包括选择的表示，所述方法还包括: 使用所述清单文件来确定所述第二适配集合中的多个表示的比特速率； 确定当前的网络带宽的量；以及从所述多个表示中选择所述选择的表示，以使得所述选择的表示的所述比特速率不超过所述当前的网络带宽的量。 10. The method according to claim 7, wherein said representation comprises a representation selection, the method further comprising: using said manifest file to determine a plurality of bit rate adaptation of the second set of representation; determining a current amount of network bandwidth; and selecting from said plurality of said selected representation represents, so that the bit rate of the selected representation of the current amount does not exceed the network bandwidth.
11.一种用于取回媒体数据的设备，所述设备包括一个或多个处理器，所述一个或多个处理器被配置为从包括第一类型的媒体数据的第一适配集合取回媒体数据，呈现来自所述第一适配集合的媒体数据，以及响应于对于切换到包括所述第一类型的媒体数据的第二适配集合的请求: 从所述第二适配集合取回包括所述第二适配集合的切换点的媒体数据，以及在实际的播出时间已经满足或者超过所述切换点的播出时间之后，呈现来自所述第二适配集合的媒体数据。 11. An apparatus for retrieving media data, said apparatus comprising one or more processors, the one or more processors are configured to include a first type of media data taken from a first set of adapter back the media data, the media presentation data from the first set of adaptation, and in response to a request to switch to a second set of adaptation of the first type comprises media data: taken from the second set of adapter Press fitting comprising the second set of switch points of media data, and after the actual broadcast time has met or exceeded the switching point of the broadcast time, rendering the media data from the second set of adaptation.
12.根据权利要求11所述的设备，其中，所述第一类型包括音频数据和字幕数据中的至少一项，其中，所述第一适配集合包括第一多个表示，所述第一多个表示包括使用第一语言的所述第一类型的媒体数据，以及其中，所述第二适配集合包括第二多个表示，所述第二多个表示包括使用不同于所述第一语言的第二语言的所述第一类型的媒体数据。 12. The apparatus according to claim 11, wherein the first type comprises at least one of audio data and subtitle data, wherein the first set comprises a first plurality of fitting said first a plurality of first language representation comprises a first type of media data, and wherein said second adapter includes a second set of a plurality of said second plurality of said different from the first representation includes using the second language of the language type of the first media data.
13.根据权利要求11所述的设备，其中，所述第一类型包括视频数据，其中，所述第一适配集合包括第一多个表示，所述第一多个表示包括第一照相机角度的视频数据，以及其中，所述第二适配集合包括第二多个表示，所述第二多个表示包括不同于所述第一照相机角度的第二照相机角度的视频数据。 13. The apparatus according to claim 11, wherein said first type comprises video data, wherein the first set comprises a first plurality of fitting said first plurality representing a first camera angle comprises video data, and wherein said second adapter includes a second set of a plurality of said second plurality of said representation comprises a first camera angle different from the second camera angles of video data.
14.根据权利要求11所述的设备，其中，在接收到对于切换到所述第二适配集合的所述请求时，所述切换点的所述播出时间小于在接收到对于切换的所述请求时的所述实际的播出时间加上门限值。 14. The apparatus according to claim 11, wherein, upon receiving the request for switching to the second set of adaptation, the broadcast time is less than the switching point for the handover is received in the the actual time of said broadcast request time plus a threshold value.
15.根据权利要求11所述的设备，其中，在接收到对于切换到所述第二适配集合的所述请求时，所述切换点的所述播出时间大于在接收到对于切换的所述请求时的所述实际的播出时间，以及其中，所述一个或多个处理器还被配置为:从所述第一适配集合和所述第二适配集合取回数据，直到从所述第二适配集合取回的媒体数据的播出时间已经满足或者超过所述实际的播出时间为止。 15. The apparatus according to claim 11, wherein, upon receiving the request for switching to the second set of adaptation, the switching point is greater than the air time for the handover to receive the the actual time of the request in broadcast time, and wherein the one or more processors are further configured to: data from the first set and the adapted second set adapted to retrieve, from up the second set of broadcast time adapted to retrieve media data so far been met or exceeded the actual broadcast time.
16.根据权利要求11所述的设备，其中，所述一个或多个处理器还被配置为:获得针对所述第一适配集合和所述第二适配集合的清单文件，使用所述清单文件的数据来确定所述切换点的播出时间，以及至少部分基于所述切换点的所述播出时间与当接收到对于切换到所述第二适配集合的所述请求时的所述实际的播出时间的比较，来取回所述媒体数据。 16. The apparatus according to claim 11, wherein the one or more processors are further configured to: obtain for the first set and the adapted second set adapted manifest file, using the determining a list of data files broadcast time of the switching point, and at least a portion of the switching point based on the broadcast time and the time for switching to the second set of adaptation when the request is received comparing said actual broadcast time, to retrieve the media data.
17.根据权利要求11所述的设备，其中，所述一个或多个处理器还被配置为:获得针对所述第一适配集合和所述第二适配集合的清单文件，以及使用所述清单文件的数据来确定所述切换点在所述第二适配集合的表示中的位置。 17. The apparatus according to claim 11, wherein the one or more processors are further configured to: obtain the first set and the second adapter adapted manifest file set, and for using the said list data file to determine the position of the switching point representing a second set of adaptation.
18.根据权利要求17所述的设备，其中，所述位置至少部分地由所述第二适配集合的所述表示的片段中的起始字节来限定。 18. The apparatus according to claim 17, wherein said segment start byte position at least partially by the second set of representation in the adaptation defined.
19.根据权利要求17所述的设备，其中，所述一个或多个处理器被配置为:取回包括至少所述切换点的所述位置的所述第二适配集合的所述表示的数据。 19. The apparatus according to claim 17, wherein the one or more processors are configured to: retrieve said location comprising at least the switching point of the second set of expressed adapted data.
20.根据权利要求17所述的设备，其中，所述表示包括选择的表示，以及其中，所述一个或多个处理器还被配置为:使用所述清单文件来确定所述第二适配集合中的多个表示的比特速率，确定当前的网络带宽的量，以及从所述多个表示中选择所述选择的表示，以使得所述选择的表示的所述比特速率不超过所述当前的网络带宽的量。 20. The apparatus according to claim 17, wherein said representation comprises a representation selection, and wherein the one or more processors are further configured for: using said manifest file to determine the second adapter a plurality of bit rate expressed in the set, determining the amount of the current network bandwidth, and selecting from said plurality of said selected representation, said representation such that the selection of the bit rate does not exceed the current the amount of network bandwidth.
21.—种用于取回媒体数据的设备，所述设备包括: 用于从包括第一类型的媒体数据的第一适配集合取回媒体数据的单元； 用于呈现来自所述第一适配集合的媒体数据的单元； 用于响应于对于切换到包括所述第一类型的媒体数据的第二适配集合的请求，从所述第二适配集合取回包括所述第二适配集合的切换点的媒体数据的单元；以及用于响应于所述请求，在实际的播出时间已经满足或者超过所述切换点的播出时间之后，呈现来自所述第二适配集合的媒体数据的单元。 21.- kinds of apparatus for retrieving media data, the apparatus comprising: means for retrieving media data comprises a first type of media data from a first set of adapter; for presentation from the first aptamer unit with a set of media data; means in response to a request to switch to the second fitting comprises a first set of media data type, retrieving from said second adapter comprising a second adapter set a switching unit set of media data point; and in response to the request has been met or exceeded the actual broadcast time of the broadcast time point after handover, the media presentation from the second set of adapter the unit of data.
22.根据权利要求21所述的设备，其中，所述第一类型包括音频数据和字幕数据中的至少一项，其中，所述第一适配集合包括第一多个表示，所述第一多个表示包括使用第一语言的所述第一类型的媒体数据，以及其中，所述第二适配集合包括第二多个表示，所述第二多个表示包括使用不同于所述第一语言的第二语言的所述第一类型的媒体数据。 22. The apparatus according to claim 21, wherein the first type comprises at least one of audio data and subtitle data, wherein the first set comprises a first plurality of fitting said first a plurality of first language representation comprises a first type of media data, and wherein said second adapter includes a second set of a plurality of said second plurality of said different from the first representation includes using the second language of the language type of the first media data.
23.根据权利要求21所述的设备，其中，所述第一类型包括视频数据，其中，所述第一适配集合包括第一多个表示，所述第一多个表示包括第一照相机角度的视频数据，以及其中，所述第二适配集合包括第二多个表示，所述第二多个表示包括不同于所述第一照相机角度的第二照相机角度的视频数据。 23. The apparatus according to claim 21, wherein said first type comprises video data, wherein the first set comprises a first plurality of fitting said first plurality representing a first camera angle comprises video data, and wherein said second adapter includes a second set of a plurality of said second plurality of said representation comprises a first camera angle different from the second camera angles of video data.
24.根据权利要求21所述的设备，其中，在接收到对于切换到所述第二适配集合的所述请求时，所述切换点的所述播出时间小于在接收到对于切换的所述请求时的所述实际的播出时间加上门限值。 24. The apparatus according to claim 21, wherein, upon receiving the request for switching to the second set of adaptation, the broadcast time is less than the switching point for the handover is received in the the actual time of said broadcast request time plus a threshold value.
25.根据权利要求21所述的设备，其中，在接收到对于切换到所述第二适配集合的所述请求时，所述切换点的所述播出时间大于在接收到对于切换的所述请求时的所述实际的播出时间，还包括:用于从所述第一适配集合和所述第二适配集合取回数据，直到从所述第二适配集合取回的媒体数据的播出时间已经满足或者超过所述实际的播出时间为止的单元。 25. The apparatus according to claim 21, wherein, upon receiving the request for switching to the second set of adaptation, the switching point is greater than the air time for the handover to receive the the actual broadcast time of said request, further comprising: means for adapting from the first set and the second set is adapted to retrieve data until retrieved from the second set of media adaptation data broadcast time has been met or until the actual broadcast time exceeds the unit.
26.根据权利要求21所述的设备，还包括: 用于获得针对所述第一适配集合和所述第二适配集合的清单文件的单元；以及用于使用所述清单文件的数据来确定所述切换点的播出时间的单元， 其中，所述用于取回所述媒体数据的单元包括:用于至少部分基于所述切换点的所述播出时间与当接收到对于切换到所述第二适配集合的所述请求时的所述实际的播出时间的比较来取回所述媒体数据的单元。 26. The apparatus according to claim 21, further comprising: means for obtaining a list of documents for the first set and the adapted second set of adaptation; and means for using said manifest file data to point determination unit broadcast time of the switching, wherein the means for retrieving the media data units comprises: means for broadcasting on at least part of the time when the switching point for the handover to the received comparing the actual time of the second set of broadcast time adaptation request to retrieve the media data units.
27.根据权利要求21所述的设备，还包括: 用于获得针对所述第一适配集合和所述第二适配集合的清单文件的单元；以及用于使用所述清单文件的数据来确定所述切换点在所述第二适配集合的表示中的位置的单元。 27. The apparatus according to claim 21, further comprising: means for obtaining a list of documents for the first set and the adapted second set of adaptation; and means for using said manifest file data to position determining means in said second adaptation represented in the set of switches.
28.根据权利要求27所述的设备，其中，所述位置至少部分地由所述第二适配集合的所述表示的片段中的起始字节来限定。 28. The apparatus according to claim 27, wherein said segment start byte position at least partially by the second set of representation in the adaptation defined.
29.根据权利要求27所述的设备，其中，所述用于从所述第二适配集合取回所述媒体数据的单元包括:用于从所述第二适配集合取回包括至少所述切换点的所述位置的所述表示的数据。 29. The apparatus according to claim 27, wherein the means for retrieving the media data set from said second adaptation unit comprises: means for retrieving from said second set comprises at least the adapter the position of said data switching point representation.
30.根据权利要求27所述的设备，其中，所述表示包括选择的表示，还包括: 用于使用所述清单文件来确定所述第二适配集合中的多个表示的比特速率的单元； 用于确定当前的网络带宽的量的单元；以及用于从所述多个表示中选择所述选择的表示，以使得所述选择的表示的所述比特速率不超过所述当前的网络带宽的量的单元。 30. The apparatus according to claim 27, wherein said representation comprises a representation selection, further comprising: means for using said manifest file to determine the second plurality of bit rate adaptation unit represented by the set of ; means for determining an amount of current network bandwidth; and means for selecting from said plurality of said selected representation represents, representing the selected such that the bit rate does not exceed the current network bandwidth unit amount.
31.—种具有存储于其上的指令的计算机可读存储介质，当所述指令被执行时，使处理器: 从包括第一类型的媒体数据的第一适配集合取回媒体数据； 呈现来自所述第一适配集合的媒体数据；以及响应于对于切换到包括所述第一类型的媒体数据的第二适配集合的请求: 从所述第二适配集合取回包括所述第二适配集合的切换点的媒体数据；以及在实际的播出时间已经满足或者超过所述切换点的播出时间之后，呈现来自所述第二适配集合的媒体数据。 31.- computer readable storage medium having instructions stored thereon that, when executed, cause a processor to: retrieving a first type of media data includes media data from a first set of adaptation; presentation media from the first adaptation data set; and in response to a request to switch to the second fitting comprises a first set of media data type: retrieving from said second adapter comprising said first set two switching point adaptation set of media data; and after the actual broadcast time has met or exceeded the switching point of the broadcast time, rendering the media data from the second set of adaptation.
32.根据权利要求31所述的计算机可读存储介质，其中，所述第一类型包括音频数据和字幕数据中的至少一项，其中，所述第一适配集合包括第一多个表示，所述第一多个表示包括使用第一语言的所述第一类型的媒体数据，以及其中，所述第二适配集合包括第二多个表示，所述第二多个表示包括使用不同于所述第一语言的第二语言的所述第一类型的媒体数据。 32. The computer-readable storage medium of claim 31, wherein the first type data includes audio data and at least one subtitle, wherein said first adapter comprising a first plurality of set expressed as claimed in claim, said first plurality of said first language representation comprises a first type of media data, and wherein said second adapter includes a second set of a plurality of said plurality of said second representation includes using a different the first language in the second language of a first type of media data.
33.根据权利要求31所述的计算机可读存储介质，其中，所述第一类型包括视频数据，其中，所述第一适配集合包括第一多个表示，所述第一多个表示包括第一照相机角度的视频数据，以及其中，所述第二适配集合包括第二多个表示，所述第二多个表示包括不同于所述第一照相机角度的第二照相机角度的视频数据。 33. The computer-readable storage medium of claim 31, wherein said first type comprises video data, wherein the first set comprises a first plurality of fitting said plurality of the first representation includes a first camera angle video data, and wherein said second adapter includes a second set of a plurality of said second plurality of said representation comprises a first camera angle different from the second camera angles of video data.
34.根据权利要求31所述的计算机可读存储介质，其中，在接收到对于切换到所述第二适配集合的所述请求时，所述切换点的所述播出时间小于在接收到对于切换的所述请求时的所述实际的播出时间加上门限值。 34. The computer-readable storage medium of claim 31, wherein, upon receiving the handover respect to said second request set of adaptation, the switching time is less than the point of receiving the broadcast for the handover request when the actual broadcast time plus a threshold value.
35.根据权利要求31所述的计算机可读存储介质，其中，在接收到对于切换到所述第二适配集合的所述请求时，所述切换点的所述播出时间大于在接收到对于切换的所述请求时的所述实际的播出时间，还包括使所述处理器从所述第一适配集合和所述第二适配集合取回数据直到从所述第二适配集合取回的媒体数据的播出时间已经满足或者超过所述实际的播出时间为止的指令。 35. The computer-readable storage medium of claim 31, wherein, upon receiving the handover respect to said second set of adapter request, the handover time is greater than the point of receiving the broadcast for the handover request when the actual broadcast time, further comprising the processor and the second set from the first set adapted adapted to retrieve data from the second adapter until retrieving a set of broadcast time of the media data has been met or exceeded instruction until the actual time of the broadcast.
36.根据权利要求31所述的计算机可读存储介质，还包括使所述处理器执行以下操作的指令: 获得针对所述第一适配集合和所述第二适配集合的清单文件；以及使用所述清单文件的数据来确定所述切换点的播出时间， 其中，使所述处理器取回所述媒体数据的所述指令包括使所述处理器至少部分基于所述切换点的所述播出时间与当接收到对于切换到所述第二适配集合的所述请求时的所述实际的播出时间的比较来取回所述媒体数据的指令。 36. The computer-readable storage medium of claim 31, further comprising instructions that cause the processor to perform: obtaining a list of documents for the first set and the adapted second set of adaptation; and data using said manifest file to determine the playout time of the switching point, wherein the instructions cause the processor to retrieve the media data processor comprising said at least part of the switching point based on the when receiving said broadcast time and the switching instruction for comparing the actual time of the request for adapting the second set of broadcast time to retrieve the media data.
37.根据权利要求31所述的计算机可读存储介质，还包括使所述处理器执行以下操作的指令: 获得针对所述第一适配集合和所述第二适配集合的清单文件；以及使用所述清单文件的数据来确定所述切换点在所述第二适配集合的表示中的位置。 37. The computer-readable storage medium of claim 31, further comprising instructions that cause the processor to perform: obtaining a list of documents for the first set and the adapted second set of adaptation; and data using said manifest file to determine the position of the switching point representing a second set of adaptation.
38.根据权利要求37所述的计算机可读存储介质，其中，所述位置至少部分地由所述第二适配集合的所述表示的片段中的起始字节来限定。 38. The computer-readable storage medium of claim 37, wherein said segment start byte position at least partially by the second set of representation in the adaptation defined.
39.根据权利要求37所述的计算机可读存储介质，其中，使所述处理器从所述第二适配集合取回所述媒体数据的所述指令包括:使所述处理器从所述第二适配集合取回包括至少所述切换点的所述位置的所述表示的数据的指令。 37 39. The computer-readable storage medium of claim, wherein the adapter from the second set of instructions to retrieve the media data the processor comprising: said processor from said retrieving a second set of instructions comprising adapting at least the position of the switching point of the data representation.
40.根据权利要求37所述的计算机可读存储介质，其中，所述表示包括选择的表示，还包括使所述处理器执行以下操作的指令: 使用所述清单文件来确定所述第二适配集合中的多个表示的比特速率； 确定当前的网络带宽的量；以及从所述多个表示中选择所述选择的表示，以使得所述选择的表示的所述比特速率不超过所述当前的网络带宽的量。 40. The computer-readable storage medium of claim 37, wherein said representation comprises the selected representation, further comprising the processor to perform the following instructions: using said manifest file to determine the second aptamer a plurality of bit rate expressed in the feature set; determining an amount of current network bandwidth; and selecting from said plurality of said selected representation represents, so that the bit rate of the selected representation of no more than the current amount of network bandwidth.
CN 201480055085 2013-10-08 2014-09-09 During a media streaming method of switching between the adapting means and the collection CN105612753B (en)
US14/048,210 2013-10-08
US14048210 US9270721B2 (en) 2013-10-08 2013-10-08 Switching between adaptation sets during media streaming
PCT/US2014/054729 WO2015053895A1 (en) 2013-10-08 2014-09-09 Switching between adaptation sets during media streaming
CN 201810435491 CN108322775A (en) 2013-10-08 2014-09-09 Switching method and device between adaptation sets during media streaming
CN105612753A true true CN105612753A (en) 2016-05-25
CN105612753B CN105612753B (en) 2018-05-15
ID=51627353
CN 201480055085 CN105612753B (en) 2013-10-08 2014-09-09 During a media streaming method of switching between the adapting means and the collection
US (1) US9270721B2 (en)
EP (1) EP3056011A1 (en)
JP (1) JP6027291B1 (en)
KR (1) KR101703179B1 (en)
CN (2) CN105612753B (en)
CA (1) CA2923163A1 (en)
WO (1) WO2015053895A1 (en)
KR101873969B1 (en) * 2014-06-30 2018-07-04 에코스타 테크놀로지스 엘엘씨 Adaptive data segment delivery arbitration for bandwidth optimization
CA2774923A1 (en) * 2009-09-22 2011-03-31 Michael G. Luby Enhanced block-request streaming system using signaling or block creation
TW201304551A *
EP2547062B1 (en) 2011-07-14 2016-03-16 Nxp B.V. Media streaming with adaptation
JP6027291B1 (en) 2016-11-16 grant
EP3056011A1 (en) 2016-08-17 application
CN105612753B (en) 2018-05-15 grant
KR101703179B1 (en) 2017-02-06 grant
KR20160058189A (en) 2016-05-24 application
CA2923163A1 (en) 2015-04-16 application
US9270721B2 (en) 2016-02-23 grant
WO2015053895A1 (en) 2015-04-16 application
JP2016538752A (en) 2016-12-08 application
CN108322775A (en) 2018-07-24 application
US20150100702A1 (en) 2015-04-09 application
CN1949876A (en) 2007-04-18 Method and system for supporting media data of multi-coding formats
US8752113B1 (en) 2014-06-10 Insertion of graphic overlays into a stream
CN1802858A (en) 2006-07-12 System and method for internet broadcasting of mpeg-4-based stereoscopic video
US20130091297A1 (en) 2013-04-11 Switching between representations during network streaming of coded multimedia data
KR20110053177A (en) 2011-05-19 Method and apparatus for adaptive streaming based on segmentation
US20150100702A1 (en) 2015-04-09 Switching between adaptation sets during media streaming