Source: https://www.scribd.com/document/164177247/TS-102-250-3-V2-2-1
Timestamp: 2018-05-22 21:50:05
Document Index: 620608904

Matched Legal Cases: ['art 3', 'art 3', 'art 5', 'art 1', 'art 2', 'art 3', 'art 4', 'art 5', 'art 6', 'art 7', 'art 2', 'art 7', 'art 1', 'art 5', 'art 2', 'art 4', 'art 2', 'art 3', 'art 6', 'art 2', 'art 2', 'art 5', 'art 5', 'art 1', 'art 2', 'art 2', 'art.1', 'art.2', 'art 5', 'art 5', 'art 5']

TS 102 250-3 - V2.2.1 | Quality Of Service | Network Protocols
Uploaded by Hoài Hà
ETSI TS 102 250-3 V2.2.
1 (2011-04)
Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in mobile networks; Part 3: Typical procedures for Quality of Service measurement equipment
ETSI TS 102 250-3 V2.2.1 (2011-04)
RTS/STQ-00178m
3G, GSM, network, QoS, service, speech
Intellectual Property Rights ................................................................................................................................6 Foreword.............................................................................................................................................................6 Introduction ........................................................................................................................................................7 1 2
Scope ........................................................................................................................................................8 References ................................................................................................................................................8
Normative references ......................................................................................................................................... 8 Informative references ........................................................................................................................................ 8
Definitions and abbreviations ...................................................................................................................8
Definitions .......................................................................................................................................................... 8 Abbreviations ..................................................................................................................................................... 9
Aim of measurement ..............................................................................................................................10 Classification of services ........................................................................................................................10
Classification guidelines................................................................................................................................... 10 General structure of service descriptions.......................................................................................................... 11
6.1 6.2 6.2.1 6.2.2
General aspects for all types of services.................................................................................................11
Set-up and control ............................................................................................................................................ 11 Phase and result classification .......................................................................................................................... 11 Phase and result classification for direct services ....................................................................................... 12 Phase and result classification for store-and-forward services ................................................................... 12
7.1 7.1.1 7.1.2 7.1.3 7.1.4 7.1.5 7.2 7.2.1 7.2.2 7.2.3 7.2.4 7.2.5 7.3 7.3.1 7.3.2 7.3.3 7.3.4 7.3.5 7.3.6 7.4 7.4.1 7.4.2 7.4.3 7.4.4 7.4.5
Telephony measurements .......................................................................................................................13
General aspects ................................................................................................................................................. 13 Transaction definition and transaction types............................................................................................... 13 Parameter overview .................................................................................................................................... 13 Additional transaction result definitions ..................................................................................................... 14 Content quality............................................................................................................................................ 14 Verification of usable two-way connection ................................................................................................ 15 Speech telephony.............................................................................................................................................. 15 Transaction definition and transaction types for speech telephony ............................................................ 15 Parameter overview for speech telephony .................................................................................................. 15 Additional transaction results for speech telephony ................................................................................... 15 Content quality for speech telephony.......................................................................................................... 15 Verification of usable two-way connection for speech telephony .............................................................. 15 Video telephony ............................................................................................................................................... 15 Transaction definition and transaction types for video telephony .............................................................. 15 Parameter overview for video telephony .................................................................................................... 16 Additional transaction result definitions for video telephony ..................................................................... 16 Content quality for video telephony ........................................................................................................... 16 Verification of usable two-way connection for video telephony ................................................................ 16 Call setup considerations for MTSI calls .................................................................................................... 16 Group Call ........................................................................................................................................................ 17 Transaction definition and transaction types for group calls ...................................................................... 17 Parameter overview for group calls ............................................................................................................ 17 Additional transaction result definitions for group calls ............................................................................. 17 Content quality for group calls ................................................................................................................... 18 Verification of usable connection for group calls ....................................................................................... 18
Store-and-forward services measurement ..............................................................................................18
General aspects ................................................................................................................................................. 18 Transaction phase and parameter overview ................................................................................................ 18 Additional transaction result definitions ..................................................................................................... 18 Content quality for Store-and-Forward Services ........................................................................................ 19 SMS measurements .......................................................................................................................................... 19
8.2.1 General aspects of SMS measurements ...................................................................................................... 19 8.2.2 Transaction definitions and transaction types for SMS .............................................................................. 19 8.2.3 Testing mode for SMS-MT ......................................................................................................................... 20 8.2.4 Testing mode for SMS-MO ........................................................................................................................ 20 8.2.5 Transaction phase and parameter overview for SMS.................................................................................. 20 8.2.6 Possible transaction results for SMS........................................................................................................... 20 8.2.7 Content quality for SMS ............................................................................................................................. 21 8.3 MMS ................................................................................................................................................................ 21 8.3.1 General aspects of MMS measurements ..................................................................................................... 21 8.3.2 Transaction definitions and transaction types for MMS ............................................................................. 21 8.3.3 Transaction phase and parameter overview for MMS ................................................................................ 22 8.3.4 Additional transaction result definitions for MMS ..................................................................................... 22 8.3.5 Content quality for MMS ............................................................................................................................ 23 8.4 E-Mail .............................................................................................................................................................. 23 8.4.1 Transaction definitions for E-Mail ........................................................................................................................... 23 8.4.1.1 Protocols ............................................................................................................................................... 23 8.4.1.2 Reference content .................................................................................................................................. 23 8.4.1.3 Content integrity ................................................................................................................................... 24 8.4.1.4 Push functionality ................................................................................................................................. 24 8.4.1.5 Header only download .......................................................................................................................... 24 8.4.1.6 Timeouts ............................................................................................................................................... 24 8.4.1.7 General requirements and limitations.................................................................................................... 24 8.4.2 Transaction scenarios for e-mail ................................................................................................................. 24 8.4.2.1 Upload scenario..................................................................................................................................... 25 8.4.2.2 Download scenario ................................................................................................................................ 25 8.4.2.3 End-to-end scenario with IMAP4 ......................................................................................................... 26 8.5 SDS .................................................................................................................................................................. 27
9.1 9.1.1 9.1.2 9.1.3 9.1.4 9.1.4.1 9.1.4.2 9.1.4.3 9.1.5 9.1.6 9.1.7 9.2 9.2.1 9.2.2 9.2.3 9.2.4 9.2.5 9.3 9.3.1 9.3.2 9.3.3 9.3.4 9.3.5 9.4 9.5 9.5.1 9.5.2 9.5.3 9.5.4 9.5.5 9.6 9.6.1 9.6.2
Data measurements.................................................................................................................................27
Common aspects .............................................................................................................................................. 27 Transaction definition and transaction types for data measurements.......................................................... 27 Server types ................................................................................................................................................ 27 Test data content ......................................................................................................................................... 28 Transaction phase and parameter overview ................................................................................................ 28 General .................................................................................................................................................. 28 Packet-switched access ......................................................................................................................... 29 Circuit-switched access ......................................................................................................................... 29 Possible transaction results ......................................................................................................................... 29 Content quality............................................................................................................................................ 30 Content integrity ......................................................................................................................................... 30 FTP ................................................................................................................................................................... 30 Transaction definition and transaction types for FTP ................................................................................. 30 Transaction phase and parameter overview for FTP................................................................................... 30 Possible transaction results for FTP ............................................................................................................ 30 Content quality for FTP .............................................................................................................................. 30 Content integrity for FTP ............................................................................................................................ 30 HTTP ................................................................................................................................................................ 30 Transaction definition and transaction types for HTTP .............................................................................. 30 Transaction phase and parameter overview for HTTP................................................................................ 31 Possible transaction results for HTTP......................................................................................................... 31 Content quality for HTTP ........................................................................................................................... 31 Content integrity for HTTP......................................................................................................................... 31 E-mail ............................................................................................................................................................... 31 WAP ................................................................................................................................................................. 31 Transaction definition and transaction types for WAP ............................................................................... 31 Transaction phase and parameter overview for WAP ................................................................................. 32 Possible transaction results for WAP .......................................................................................................... 33 Content quality for WAP ............................................................................................................................ 33 Content integrity for WAP .......................................................................................................................... 34 Streaming Video ............................................................................................................................................... 34 Transaction definition and transaction types for streaming video .............................................................. 34 Transaction phase and parameter overview for streaming video ................................................................ 34
...7....................................................................................................2...................................................................................................... 39 9..................3.....2......3 Possible transaction results for Streaming Video....2..8 Recommended Testing Method for Media Download ..................................3 Combined OMA download and combined delivery DRM use case................................. 35 9......................7.......7................................................................4 Content quality for Media Download ............. 36 9................7..7....1 OMA network elements .......2............................... 42 9...................2 Transaction phase and parameter overview for Media Download ........................7............................1.............7.......7......................................7....7..................................................................................................................... 34 9.....................1........................................................7................. 40 9..................1........................................................7.......................... 42 9...............................7............................. 41 9....................................................................................................2 OMA download use cases ........7.......... 38 9.................2................ 42 9.............4 Content quality for Streaming Video ................7 Additional information about parameters for Media Download ................1 Combined OMA download use case .......................................................................................1 Combined delivery DRM use case ......................3 Possible transaction results for Media Download .............3.............................6 Separate OMA download and separate delivery DRM use case .......................7........1 (2011-04) 9..................7..............1.......44 ETSI .............. 39 9......6.................................2.....7.......5 Content integrity for Media Download ........................1.......7.......................7...................................1 Overview of basic parameters for Media Download .......... 35 9...............................................2 Media Download subphases ...............2..................................................................................................5 Combined OMA download and separate delivery DRM use case .............................6........2.........................6...1.....2 Separate OMA download use case ........................................5 Content integrity for Streaming video ...................................7 Media Download .....4 Separate OMA download and combined delivery DRM use case ...... 34 9............................................2 Separate delivery DRM use case ............ 41 9.................2........ 36 9......5 ETSI TS 102 250-3 V2.. 34 9..................... 42 History ........................7...............1................. 37 9.... 41 9................... 38 9....................................2.............1 Transaction definition and types for Media Download..................................................... 42 9.. 35 9.......................... 38 9..........................................................3 DRM use cases ........................................................................................................... 42 9.....................................2....................
It summarizes the basics of Quality of Service. an abstract equation and the corresponding user and technical trigger points. The present document is part 3 of a multi-part deliverable covering the QoS aspects for popular services in mobile networks. "Requirements for Quality of Service measurement equipment". Part 5 specifies typical measurement profiles which are required to enable benchmarking of different mobile networks both within and outside national boundaries. or may be. Test equipment fulfilling the specified minimum requirements will allow performing the proposed measurements in a reliable and reproducible way. if any. as identified below: Part 1: Part 2: Part 3: Part 4: Part 5: Part 6: Part 7: "Assessment of Quality of Service". "Typical procedures for Quality of Service measurement equipment".6 ETSI TS 102 250-3 V2. is publicly available for ETSI members and non-members. essential to the present document. "Definition of Quality of Service parameters and their computation".2. Part 2 defines QoS parameters and their computation for popular services in mobile networks.asp). Latest updates are available on the ETSI Web server (http://webapp. IPRs notified to ETSI in respect of ETSI standards". or potentially Essential. Part 7 describes how Quality of Service measurements should be done inside the network without direct access to the end point terminal. The information pertaining to these essential IPRs. no investigation. Part 1 builds an umbrella document for this multi-part deliverable. In extension to generic definitions. or may become. No guarantee can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are. ETSI . Pursuant to the ETSI IPR Policy. has been carried out by ETSI. specific definitions for this multi-part deliverable are stated here.1 (2011-04) Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to ETSI. which is available from the ETSI Secretariat. applying the test profiles defined in part 5. Differences to Quality of Experience (QoE) are also discussed. The present document describes the measurement procedures needed to perform the measurements of QoS parameters in line with the definitions given in part 2. Essential. Foreword This Technical Specification (TS) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality (STQ). The parameter definition is split into several parts. including IPR searches.org/IPR/home. Part 4 defines the minimum requirements of QoS measurement equipment for mobile networks in the way that the values and trigger points needed to compute the QoS parameter as defined in part 2 can be measured following the procedures defined in part 3. Furthermore. "Definition of typical measurement profiles".etsi. it gives guidance to assure that QoS assessments can be conducted in a meaningful way and proposes an according process. and can be found in ETSI SR 000 314: "Intellectual Property Rights (IPRs). "Network based Quality of Service measurements". Part 6 describes procedures to be used for statistical calculations in the field of QoS measurement of mobile networks using probing systems. "Post processing and statistical methods". It contains an abstract definition which gives a generic description of the parameter. The harmonized definitions given in part 2 are considered as prerequisites for the comparison of QoS measurements and measurement results. always seen from the user's perspective.
ETSI . not only computation rules have to be standardized.1 (2011-04) Introduction The present document describes the measurement procedures needed to perform the measurements of QoS parameters in line with the definitions given in part 2 [i. well-defined procedure definitions are also required to ensure comparable data.7 ETSI TS 102 250-3 V2. The aim of standardization of QoS measurements is to ensure that measurements done at different times and with different equipment produce comparable results.2.5]. To reach this goal. applying the test profiles defined in part 5 [3]. Since the result of measurements will depend on the way these measurements are performed.
Part 5: Definition of typical measurement profiles".version 4rev1". Referenced documents which are not found to be publicly available in the expected location might be found at http://docbox. QoS aspects for popular services in GSM and 3G networks.56: "Objective measurement of active speech level".8 ETSI TS 102 250-3 V2.1 [1] [2] [3] Normative references ITU-T Recommendation P.2] [i. [i. Where possible.org/Reference. For non-specific references. ETSI . Part 1: Identification of Quality of Service criteria".1 (2011-04) 1 Scope The present document describes typical procedures used for QoS measurements on mobile communication networks. ETSI TS 102 250-5: "Speech and multimedia Transmission Quality Aspects (STQ). Transmission and Quality Aspects (STQ).1] [i. QoS aspects for popular services in GSM and 3G networks. 2. NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee their long term validity. IETF RFC 2177: "IMAP4 IDLE command".2 Informative references The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. In some cases ITU-T or ETSI definitions do not exist or are considered too generic. along with settings and parameters for such measurements. IETF RFC 1939: "Post Office Protocol . then a more service and mobile network specific definition is chosen. ETSI TS 102 250-2: "Speech and multimedia Transmission Quality (STQ). 2 References References are either specific (identified by date of publication and/or edition number or version number) or non-specific. existing ITU-T or ETSI definitions are referenced.Version 3". the latest version of the reference document (including any amendments) applies.4] [i. only the cited version applies. For specific references. IETF RFC 2821: "Simple Mail Transfer Protocol". QoS aspects for popular services in GSM and 3G networks. The following referenced documents are necessary for the application of the present document. ETSI TS 102 250-1: "Speech Processing.3] [i.5] IETF RFC 3501: "Internet message access protocol . 2. Part 2: Definition of Quality of Service parameters and their computation".etsi.2.
A parameter set is assumed to be complete if. transaction result: set (list) of possible outcomes for a particular transaction NOTE: Services belonging to the same service family share the same set of transaction results.1 Definitions and abbreviations Definitions For the purposes of the present document. B-party: in direct transactions.1 (2011-04) 3 3.2. store-and forward transaction: transaction where information is sent from one party A to another party B using an entity C to store information sent from A and attempting to deliver it to B transaction: single. NOTE 2: Each type of transaction has parameters. Single text message in SMS service. the party sending content. information flow to achieve the state of being able to transfer actual user data is not counted as content. the typical transaction for this particular service is described. The sum of all parameters describes the transaction completely. the termination or counterpart of a transaction NOTE: In store-and-forward transactions. the party initiating the transaction (calling party) NOTE: In store-and-forward transactions.9 ETSI TS 102 250-3 V2. audio. under constant outer conditions. complete. single multimedia message consisting of video. typical usage of a particular service NOTE 1: At the beginning of each clause describing a particular service or family of services. EXAMPLE: direct transaction: real-time transaction between two entities maximum expected delivery time: for store-and-forward services. seen from the user's perspective NOTE: In case of services requiring entrance procedures (e. are assumed to form a service family. the following abbreviations apply: ETSI . server login with FTP). all transactions using this parameter set provide the same result. this defines the time span within which a message shall be received by the B-party to rate the transaction successful from the user's perspective service family: group of services having main characteristics in common EXAMPLE: Speech and Video Telephony. the following terms and definitions apply: A-party: in direct transactions. and text components in MMS service. 3.g.2 AOV APN CS CSD DNS DRM FTP GGSN GPRS GW HTTP Abbreviations Angles Of View Access Point Name Circuit Switched Circuit Switched Data Domain Name Server Digital Rights Management File Transfer Protocol Gateway GPRS Support Node General Packet Radio Service Gateway Hyper Text Transfer Protocol For the purposes of the present document. the party receiving content. as well as SMS and MMS. content: entirety of information transferred within a transaction.
in the user's perception .10 ETSI TS 102 250-3 V2. Store-and-forward services are services where content is stored in the network and delivered to the recipient at a later point in time.5] of this multi-part deliverable. The first distinction is made between direct and store-and-forward services: • • Direct-transaction services are services where there is . to determine the network quality for the respective transactions from the user's view.5].2. As a technically usable differentiation. it is.1 Classification of services Classification guidelines For the purpose of the present document. 5 5. a service is considered to be direct if it is possible to decide on end-to-end content transfer success from the initiating party (A-party) of the connection within the scope of the transaction itself. NOTE: e-Mail is a special case since it has both aspects of direct and of store and forward services.a direct end-to-end connection. as in part 2 [i.1 (2011-04) IP MEDT MMS MO MOF MOM MS MT MTM MTU NAT PC PDP PDU POP3 PS PSD QoS RTP S&F SDS SMS SMSC TCP/IP UDP UE URI URL WAP WAP XHTML Internet Protocol Maximum Expected Delivery Time Multimedia Messaging Service Mobile Originated Mobile Originated to Fixed Mobile Originated to Mobile Mobile Station Mobile Terminated Mobile Terminated. ETSI . originator is also a Mobile unit Maximum Transmission Unit Network Address Translation Personal Computer Packet Data Protocol Packet Data Unit Post Office Protocol Version 3 Packet Switched Packet Switched Data Quality of Service Realtime Transport Protocol Store and Forward Short Data Service Short Message Service Short Message Service Centre Transmission Control Protocol/Internet Protocol User Datagram Protocol User Equipment Uniform Resource Identifier Uniform Resource Locator Wireless Access Protocol Wireless Application Protocol eXtensible Hyper Text Markup Language 4 Aim of measurement The aim of measurements described in the present document is to assess the network under test for its Quality of Service (QoS) parameters as defined in TS 102 250-2 [i. In the present document. services are classified using what is considered to be their dominating property. This is. treated in the clause on store and forward services.
that pause times are sufficiently long that the equipment is in a stable (idle) state again. a testcase consists of a number of single identical transactions. Phases may be further described having sub-phases. transaction types.shall be part of the measurement documentation. Values are technology-dependent. This includes. The measurement equipment and control must ensure that the starting conditions are the same for each transaction.2 Phase and result classification In order to ensure common wording. It is assumed that for all types of services under test. a service-dependent part having the same structure as above. It is assumed that each transaction can be described at least by one seamless sequence of phases. Parameters and settings which have substantial influence on results need to be under control of the measurement equipment. Each AOV. a description of content quality measurement definitions (if applicable). each leading to a different phase description.1 (2011-04) 5.1 General aspects for all types of services Set-up and control Measurements should be conducted in a way that user behaviour is realistically modelled. AOV differ here by different assumptions on start of service usage. a description of the transaction phase combined with a table of parameters governing transaction behaviour in this phase. however.11 ETSI TS 102 250-3 V2. 6. It is assumed that all QoS-relevant transaction parameters are recorded for proper post-processing and are kept constant during measurements. a description of all possible outcomes of a single transaction. If a measurement contains more than one parameter set. Pauses between transactions are not explicitly mentioned in this picture. 6 6.2. Typically. each service family description will contain the following structural elements: • In case there are service-dependent differences. the following clause defines terms and definitions for service measurements.to the degree necessary to fully reproduce the test . In the following. evaluation shall be made for each parameter set separately.2 • General structure of service descriptions A general part defining: the basic transaction definition and if applicable. The testcase design (configuration and user profile) . ETSI . There may exist several Angles Of View (AOV).5] model A and B). there is a minimum pause (guard time) ensuring that the system under test is in a stable starting condition for the next test. among other things. EXAMPLE: Internet services (as described by its QoS parameters defined in TS 102 250-2 [i. is a consistent description by seamlessly connected phases. The parameter "guard time" sets a minimum value for the pause between transactions. but are relevant with respect to parameter reporting.
This behaviour has to be recorded by the measurement system. Table 2: General result classification for direct services Definition Phase of service usage not reached. ETSI . It is assumed that the A-party gets information sufficient to judge if sending has been successful or not. This phase is completed when there is nothing more the A-party can/needs to do to transfer content to the B-party. Example: Network access failed Completed Data-transfer transactions: All content intended to be transferred has been successfully transferred.2. Service access may consist of different subphases. Content transfer between A. The general name-forming rule is: <name of sub-phase>result. up to the point where the network is able to start delivery. to enhance test rate. e. IP service access and Internet access. e. Conversational transactions: The intended transaction duration has been reached. Basic access to the generic packet-data transfer capabilities the particular service is based upon. Delivery may consist of two main sub-phases: notification and retrieval.and B-party. Information to the B-party that content is ready for transfer.g.2.2 Phase and result classification for store-and-forward services Table 3: General phase definitions for store-and-forward services A store-and-forward transaction consists of two top-level phases: content sending and content delivery. Phase Content sending Sub-phase Content delivery Notification (optional) Retrieval/Delivery Definition All steps required to transfer the content to the network. Basic access to those internet services the service is meant to provide. Failed Result 6.12 ETSI TS 102 250-3 V2. All steps to transfer the content from the network to the B-party.and B-party. this shall be treated as a dropped transaction. The availability of these sub-phases actually depends on the particular service. Basic access to the network under test. Transport of content from network to B-party.1 (2011-04) 6. Successful network access is assumed when the UE is able to do as much basic communication with the network as is necessary to initiate the next phase in the service access procedure.2. NOTE: If a transaction being in the service usage phase is stopped due to some timeout or due to other criteria by the measurement system.g.1 Phase and result classification for direct services Table 1: General phase definitions for direct services A direct transaction consists of two top-level phases: service access and service usage. Dropped/Cut-off Service usage was ended before completion. A direct transaction may have one of the following overall results. Successful or failed service access may be broken down into diagnostic sub-categories. Phase Service access Sub-phase Network access IP service access Internet access Service usage Definition All steps leading to the technical ability to perform actual user-perspective content transport between A. Network access.
1 (2011-04) A Store-and-forward transaction may have one of the following overall results. side effects may occur. called party number). this duration may be adjusted to local conditions or special testing goals.2. Basically. the term "content" will be used throughout this clause for the information flow exchanged between participating users during a call. Diagnostic sub-category in case notification can/shall be technically identified within the delivery process.Downlink only. Depending on particular services and available information. This includes the type of equipment (dedicated unit. but notification was never received by the B-party. a pause time of at least 15 seconds (guard time) is recommended. Table 4: General result classification for store-and-forward services Result Completed Failed Sub-category Definition Content was successfully transferred from A. ETSI .Uplink only. Codec settings."Duplex" (uplink and downlink flow simultaneously). there may be a number of possible sub-categories for this result. but this must be reported. 7. . but was never (or: not within a desired period of time.1 7. etc.1 General aspects Transaction definition and transaction types The basic transaction for telephony testing is equivalent to a single call to a counterpart extension. all combinations of uplink/downlink dynamics are possible: . Depending on the type of service. This is the recommended standard testing mode.to B-party. It should be made certain that all the QoS parameters to be measured are not affected by the pause time. content can be audio or audio and video. Content was not successfully transferred from A. Algorithm and scale used for speech quality evaluation. but the content delivery time was above a given threshold. In general. Pause duration. see note) delivered or retrieved. However.g. Undelivered Send failed Lost Timeout 7 Telephony measurements This clause deals with telephony services. 7.13 ETSI TS 102 250-3 V2.to B-party. Content was successfully sent to the network. . If the pause duration is too short. For current UEs.2 Parameter overview Table 5: Parameter overview for telephony measurements Parameters Call counterpart. resulting in all kinds of transient effects and distortions in measurement data. Phase Service Access Service Usage Call clear-down Pause The last transaction within a measurement sequence does not require a pause.Conversational (alternating uplink and downlink). Guard time. Content flow direction: This is an inner parameter for a transaction.). Time-out value Call duration. Content was successfully sent to the network. Content was not successfully delivered to the network. Other testing modes are considered to be used only for special purposes. unique identifier (e. Call type. automatic answer with taped message. The transaction was completed.1. .1.
at least the following methods are possible: • • Real-time assessment (streaming mode). shall be verified by a procedure based on content test transmissions within a given time window. "Offline" assessment. presence of a usable two-way connection. For assessing content quality of complete transmitted speech samples. Above definitions lead to the following decision tree for the outcome of a call (Figure 1 includes the end-of-call cases). ETSI . data is generated at the receiving end.1.4 Content quality For content quality assessment.1 (2011-04) 7. the setup attempt shall be considered as failed and the call attempt be terminated.2. where content is first recorded in some way and later being processed. i. For downlink content. A call is therefore considered to be dropped if either side detects a dropped call. where the quality assessment algorithm continuously outputs the defined quality measures. Call Attempt Access Failure Successful network access Setup Failure Setup Success Dropped Call Call not dropped Completed Call Figure 1: Telephony measurement outcome 7. Data processing must make sure that only such content quality data is used which lies inside the "connection active" time window and is in line with one of the defined content quality parameters. typically a state model driven by suitable trigger-events information combined with information from the call control engine is being used. data storage is therefore straightforward. A call is active only as long as both sides consider it to be active.3 Additional transaction result definitions For call set-up assessment beyond QoS data acquisition. If within this time window no connection can be verified. at some point in time results from the involved B-parties have to be combined with the data from the originating A-party.14 ETSI TS 102 250-3 V2. quality-assessment data is simply included with other data items making up the result file. For uplink content. This state model may also be used to determine timing information for each phase. Service usability.1.e.
7. it is assumed that PC-based implementations of video protocol stacks will have to be used. If within this time window no audio connection can be verified. ETSI .1.2.1 (2011-04) 7. 7.3 7. 7.2.3 Additional transaction results for speech telephony See family definitions.1 Speech telephony Transaction definition and transaction types for speech telephony See family definitions.15 ETSI TS 102 250-3 V2.2. At the time of writing. there are no known terminal-based protocol stacks delivering data necessary for testing or QoS assessment. A non-valid call shall be treated like a dropped call.3.1 Video telephony Transaction definition and transaction types for video telephony The basic transaction for video telephony testing is equivalent to a single call to a counterpart extension.4 Content quality for speech telephony See family definitions.2.5 Verification of usable two-way connection Only calls with a valid two-way end-to-end information connection shall be considered for content quality assessment (valid calls). typical video calls will be between UEs. where the UE serves only as the modem part of the connection. Due to existing usage and hardware.5 Verification of usable two-way connection for speech telephony This shall be verified by a procedure based on audio test transmissions within a given time window. it is assumed that an appropriate kind of data analysis on audio flow is performed (see ITU-T Recommendation P. 7.2. It is further assumed that typical tests will use data which serve as load and carry diagnostic data at the same time.2 7. NOTE: To make sure an audio connection is valid. with a modifier indicating this particular cause. 7. it is currently assumed that video-call testing will require a high degree of abstraction in the sense that testing-system architectures may differ quite thoroughly from those found in "real connections".56 [1]). so no further call types are distinguished.2. Therefore. the setup attempt shall be considered to be failed and the call attempt be terminated. 7.2 Parameter overview for speech telephony See family definitions. Unlike other services.
but lead to quality deficiencies due to inappropriate bearer properties. or handled by the MTSI clients for unmanaged NATs. It is conceivable that the network provides the wrong bearer type.3. "transparent" test of modem connection). but MTSI uses dynamic payload type assignments. Thus the client needs to use the information in the SDP and the outcome of the negotiation. Call duration. Video-telephony protocol used. 7.3 Additional transaction result definitions for video telephony It is assumed that the A and B party video-telephony protocol stacks are compatible.2. Call counterpart technology and architecture. this will either result in failure to provide a usable end-to-end connection. Guard time.3. any Network Address Translation (NAT) devices present in the call path need to be opened. is assumed to be done when the first valid media packet is received from the called party.3. 7. It is assumed that the audio part of the connection will be tested essentially the same way as for speech telephony.4 Content quality for video telephony Currently no stable specification for video quality exists. The relation between the payload type and the actual codec and codec format used is then defined in the SDP during the call setup negotiation. The RTP standard has a number of fixed media payload types. The call setup. Due to limited "decision power" determining the usability of an end-to-end connection. this could go undetected at first.5 Verification of usable two-way connection for video telephony It is assumed that the video telephony protocol being used implicitly checks for useful connection.6 Call setup considerations for MTSI calls When MTSI calls are setup.2 NOTE: Parameter overview for video telephony Content flow will typically be governed by the video protocol and is assumed to involve simultaneous data flow in both directions. Pause duration. The last transaction within a measurement sequence does not require a pause. Table 6: Parameter overview for video telephony measurements Phase Service access Service usage Call clear-down Pause Parameters Connection type (CSD bearer type). and use the first reception of that payload type as the end of the call setup phase. This includes the type of test being made (e. ETSI . 7.3.16 ETSI TS 102 250-3 V2. as seen by the calling party.1 (2011-04) 7. or the video-telephony protocol stack will detect this by indicating connection failure.3. to identify which payload type is finally agreed. and given a usable end-to-end connection of proper type. This should be interpreted as the first packet containing the negotiated media payload type. a video-telephony connection can be established. Time-out value. It is assumed that if the network cannot provide a connection with the required bearer properties.g. 7. which means that the media payload types are allocated from the range 96 to 127. This can be done automatically by the network for managed NATs.
For quality measurements the following rules apply: As a first measurement option. B1-Party. Call duration.. a former B-Party can cyclically take the role of the initiating A-party whereas the former A-party gets the role of a B-Party. In this case.…. e. the roles of the participating group members might change.3 Additional transaction result definitions for group calls It is assumed that all members of the target group are known by the measurement system(s). Type is Group Call (GC) and it will not be distinguished between Mobile Originated (MO) and Mobile Terminated (MT). A quality value per group call should apply statistical means (e. ETSI . All group members are controlled and called exclusively by the measurement system(s). side effects may occur.2 Parameter overview for group calls Table 6: Parameter overview for group call measurements Parameters Call counterparts (group to call). Either all group members may be connected to the same common measurement system at one location (not limiting that the measurement system might be in mobility) or each group member is connected to a separate measurement system and these might be distributed at various locations (again not limiting that all or some of the measurement systems might be in mobility). B2-Party. A pattern may be specified. this duration may be adjusted to local conditions or special testing goals.4. If a Bi-Party is disconnected during the group call. In both cases. Time-out for failed-call condition.2. It should be made certain that all the QoS parameters to be measured are not affected by the pause time.g. only the initiating A-Party will generate a talk burst and the group call is ended after the speech phase of the A-Party. which describes.4 7. Guard time. However. In this case. The sequence of the talking party shall be A-Party.17 ETSI TS 102 250-3 V2. Call type is Group Call. a simple approach would be the arithmetic average) with respect to aggregation and is for further study.4. all parties may talk the same amount of time.1 (2011-04) 7. 7. two options for a typical measurement scenario are available. Pause duration. Phase Service Access Service Usage Call clear-down Pause The last transaction within a test sequence does not require a pause.4. Depending on the used radio access technology the duration of required pauses may differ significantly. the quality values of this Bi-Party will be excluded from the overall quality value. The n counterparts are typically Test UEs. resulting in all kinds of transient effects and distortions in measurement data. at what point in time a certain party has to talk to the others. 7. One Test UE (A-party)will call n counterparts (Bi-parties) having 1 ≤ i ≤ n. N × (N+1) quality values are measured per group call.g. If the pause duration is too short.1 Group Call Transaction definition and transaction types for group calls The basic transaction for group call testing is an extension to an individual telephony speech call with two parties involved (A-party and B-party). but this must be reported. N quality values are measured per group call. In principle.Bn-Party. As a second measurement option. A group call always ends after the Bn-Party finished its last talking period. Content flow direction: Typically only one party can talk at one point in time.
8 8. to identify the test session within it was sent. video and text) between two parties. content is. Technical provisions are needed to ensure proper handling of such content. if the service allows for it.g. in the end-to-end perspective.4 Content quality for group calls See family definitions. ETSI . Suitable means of eliminating such effects should be taken. however. Phase Sending Notification Retrieval Pause 8. Time-out for notification. Technically it is possible that content being sent in previous test session arrive at the system after the session has been finalized. However.4. Content used by the measurement system shall carry appropriate signature to identify it as belonging to the measurement. MOM testing with a two-UE setup may cause additional uncertainty due to coverage and signalling effects in the destination UE. MT) or from one UE to another (mobile originated to mobile.2 Additional transaction result definitions The nature of store and forward services implies that loss rates need precise definition. it should be considered lost anyway. 8. and to enable unambiguous correlation between sent and received content. For practical reasons. setting a reasonable lifetime for the content item.5 Verification of usable connection for group calls The usability of the connection will be tested implicitly by the content quality algorithm.1 (2011-04) 7.4. measurements are typically limited to a certain time window.2. Part of the measurement procedure should be cyclical reference checks to assure reception quality respectively to create baseline data. testing methodology requires that measurement data are being collected in at least two locations and need to be integrated before the final QoS evaluation can be made. This leads. to the problem of over-aged content items which may disturb subsequent measurements. Pause duration. in turn.1. Basically.1. being sent either from some fixed-network source to a UE (mobile terminated. From the user's point of view. there is expectation that content is delivered within the Maximum Expected Delivery Time (MEDT). Typically. MOM).1 Transaction phase and parameter overview Table 7: Transaction phase and parameter overview for store-and-forward services Parameters Destination equipment type. there are two recommended methods of testing: a) using a destination UE in a fixed location with virtually 100 % transfer probability. either by ignoring it or by correctly assigning it in post-processing. and using unique sequence numbering in a way to prevent aforementioned effects. 7.18 ETSI TS 102 250-3 V2. or using a fixed-network destination such as a Large Account server which is accessed by suitable means from a fixed-network location. Even if technically an outstanding content item may be delivered later. contain several parts such as audio.1 Store-and-forward services measurement General aspects The basic transaction for store-and-forward services testing is equivalent to transmission of a single unit of content (which may. b) In all cases. e.
2.2. In practice. testing methodology requires that measurement data is being collected in at least two locations and needs to be integrated before the final QoS evaluation can be made. For each SMS.1. this parameter is part of the parameter structure. However. This leads to the recommendation that PDU mode should be used. There are two modes for SMS transmission: Basically. a "lifetime" can be set after which a SMS is deleted in the SMSC.2 Transaction definitions and transaction types for SMS The basic transaction for SMS testing is equivalent to transmission of a single SMS. there are two recommended methods of testing: • using a destination mobile in a fixed location with virtually 100 % transfer probability. no family definitions exist. SMS-MT).e. in text mode it is set in the mobile. Additional SMS sending attempts e. Part of the measurement procedure should be cyclical reference checks to assure reception quality respectively to create baseline data. Basically. or from one mobile to another (SMS mobile originated.19 ETSI TS 102 250-3 V2. SMSC being used. if the measurement system is shut down before a given maximum waiting time has expired. uplink SMS testing with a two-mobile setup may cause additional uncertainty due to coverage and signalling effects at the destination UE. mode support is mobile-dependent. which may not be supported by all mobile types. or using a fixed-network destination such as a Large Account SMS server which is accessed by suitable means from a fixed-network location. it is required that all SMS sending attempts which form part of the statistics must follow a constant time pattern.g.1 • • SMS measurements General aspects of SMS measurements text mode. SMS MO.2. Call counterpart.1 (2011-04) Post-processing must ensure that. The influence of over-aged content should be reduced to a minimum by using a selective retrieval. all pending units of content. 8. Call timing including behaviour in case of delivery failure to the network. these modes should be equivalent including options available. While in PDU mode. 8. i. user SMS are being sent either from some fixed-network source to a mobile (SMS mobile terminated. those with an age less than MEDT are completely removed from QoS evaluation since there is no way to predict if these elements will arrive within MEDT or not. the following outer conditions need to be constant throughout a testcase: • • • • SMS mode.3 Content quality for Store-and-Forward Services For these service types.2 8. • In all cases. ETSI . PDU mode. To ensure comparability and statistical validity of transactions. in the case of failure of delivery to the network must not affect the pattern of the statistically relevant call attempts. See the respective service-related subsections. For reasons of comparability in density. Only the content delivered within the MEDT should be downloaded when possible. with regard to mobile-based testing). 8. Typically.
the SMS storage of the UE should be cleared to exclude SMS delivery failure due to memory shortage.2. a) b) On SMS reception. SMS are being generated at a constant rate by the mobile side. Further for general design of SMS testing. the SMS may contain a code which is created from checksum content and a seed value delivered by the receiving side. 8. For example. To Mobile.20 ETSI TS 102 250-3 V2. to Large Account.4 Testing mode for SMS-MO For this type of testing. the system will be robust against it. it is mobile-dependent which modes are supported. etc. If required. communication between the mobile testing system and its stationary counterpart is required to ensure certain starting conditions: • • Prior to actual testing. The recommended minimum set includes: • • signature assuring that only test system SMS are being considered. a pause time of at least 15 s (guard time) is recommended Notification Retrieval Pause 8.2. mode a) is preferred. more powerful means of ensuring that only SMS generated by the test system can be added. a test SMS may contain additional data (padding) to obtain SMS with a length assumed to be typical for a particular network. The stationary side should start sending SMS only after a "go" from the mobile side.6 Possible transaction results for SMS See family definitions.1 (2011-04) SMS being sent from either side should contain information enabling validity and integrity checking during evaluation.2. ensuring that no transient effects occur. All SMS received which have not been generated by the stationary side shall be ignored for quality assessment. For reception behaviour. The actual SMS can then be requested by a command. e. ETSI . For current GSM equipment.) SMSC used Content size Time-out for notification Notification mode for incoming SMS Pause duration. two modes exist. plus eventual extra SMS in case of failure of delivery to the network.5 Phase Sending Transaction phase and parameter overview for SMS Table 8: Transaction phase and parameter overview for SMS Parameters Type and Destination equipment type (depends on type. the mobile generates an indication message (CMTI message) on its data connection to the PC. SMS are being generated at a constant rate by the stationary side. If required. 8.3 Testing mode for SMS-MT For this type of testing. The mobile outputs the SMS directly on its data connection to the PC. From control and trigger point accuracy considerations.g.2. 8. This ensures that even if a static signature is duplicated by operational errors or malfunction of other test systems.2. sequence number for SMS delivery timing.
call counterpart.2. In the case of MMS the destination is typically one or more e-mail addresses. Typically. user MMS are being sent either from a mobile to another mobile (MOM or MTM depending on measurement setup).g. For reasons of comparability in density. Additional MMS sending attempts e. ETSI . They shall be treated as follows: • • • Incoming SMS not being a valid push SMS shall be ignored.1 MMS General aspects of MMS measurements With respect to general aspects of store-and-forward systems. send timing including behaviour in case of delivery failure to the network. In the case of store and forward measurements.3.7 Content quality for SMS It is assumed that the SMS service protect its payload sufficiently so it can be assumed that no distortions in content will occur. in the case of failure of delivery to the network must not affect the pattern of the statistically relevant call attempts.2 Transaction definitions and transaction types for MMS The basic transaction for MMS testing is equivalent to transmission of a single MMS. Incoming valid push SMS identified as been sent by the testing system but not belonging to the current test session may be ignored (see general remarks). In mobile-to-mobile scenarios there is always the risk of ambiguity with respect to end to end quality assessment. or using an e-mail destination.3 8. or from a mobile to a fixed-network location (MOF). audio and text. the following outer conditions need to be constant throughout a testcase: • • • • MMS content. in MMS testing special care has to be taken for proper handling of incoming notification SMS not belonging to the active session. this is less critical due to the definition of QoS parameters which allow to distinguish uplink and downlink components.1 (2011-04) 8. 8. it is required that all MMS sending attempts which form part of the statistics must follow a constant time pattern. ignoring the push SMS contains the risk that a MMS successful from the user's perspective is reported as unsuccessful by the measurement system. Therefore. a "legacy SMS" is transmitted instead.21 ETSI TS 102 250-3 V2. This SMS will contain an information that and how MMS content can be downloaded via internet. The format of such legacy SMS is not standardized. If the network under test may modify push SMS content in a way that it cannot be detected if the push SMS belongs to the measurement. it is optional to download the MMS and to check if it belongs to the measurement.3. To ensure comparability and statistical validity of transactions. For all other push SMS. In case a destination mobile is classified by the network as not capable of MMS reception.2. Part of the measurement procedure should be appropriate cyclical reference checks to obtain baseline data. two methods of testing are recommended: a) b) using a B party mobile in a fixed location with very good network coverage. Nevertheless. MMS Proxy being used. NOTE: 8. which may however contain several parts such as picture or video. QoS parameters expression end-to-end performance will be affected.
2. but the recipient did not get notification within the MEDT.3 Transaction phase and parameter overview for MMS Unlike SMS.22 ETSI TS 102 250-3 V2. posting and retrieving MMS is handled via a network service (WAP) rather than embedded in low-level functionality of the network. The following definitions are to be seen in conjunction with family result definitions: • • • • Service access failed: The MMS transaction could not be started due to inability to access the network or the service. 8. the simple phase scheme . the MMS and SMS storage of the UE should be cleared to exclude failures due to memory shortage or other limitation. Dropped while posting: Content could not be uploaded successfully. If required. Lost: The content package was successfully uploaded. Dropped while retrieving: The recipient received a notification. Therefore. The recommended minimum set includes: • • signature assuring that only test system MMS are being considered. the user notices (and cares about) different ways a MMS transaction can fail. NOTE: • Completed: Content has been successfully delivered to the B-party (which includes completeness of the package).3. from technical feedback during his service usage. consequently.and. a test MMS may contain additional data (padding) to obtain content with structure and size assumed to be typical for QoS measurement purposes. have been extended by inserting subphases.3.4 Additional transaction result definitions for MMS The following definitions are based on the assumption that. this includes network or service access failure.1 (2011-04) MMS being sent from either side should contain information enabling validity and integrity checking during evaluation. Table 9: Transaction phase and parameter overview for MMS Phase Sending Subphase Network access MMS gateway access Upload Parameters Equipment Types and Capabilities MMS gateway address (Proxy used) Content composition Content size User Agent String (identification of receiving UE) Time-out for notification Equipment Type and Capabilities MMS gateway address (Proxy used) Time between MMS postings Notification Retrieval Network access MMS gateway access Download Pause 8. Also. sequence number for MMS delivery timing. uploading or downloading MMS is a process taking considerable time. communication between the mobile testing system and its stationary counterpart is required to ensure that prior to actual testing. but was unable to retrieve the MMS. the possible-result definitions. Unlike for upload. ETSI . Further for general design of MMS testing.
1]. When using the POP3 protocol the client has to poll the e-mail server for new e-mails. Client A Server A Server B Client B Upload parameters Download parameters End-to-end parameters Figure 2 8. it is not subject of the present document. version 3).4. music. forward) e-mails to the receiver side.1 E-Mail Transaction definitions for E-Mail E-mails are sent from one e-mail client to another one via one or more e-mail servers.4. Both clients can independently use a wireless or wired connection to their respective server. it is assumed that correct transcoding is validated by other means than QoS measurements. For upload tests it must be assured that successful upload is not prevented due to storage size limitations. etc. ETSI . no direct comparison of content sent and received is possible.e. For the download tests it must be assured that the required reference content is present on the server. documents. plain text or HTML) or attachments (e.5 Content quality for MMS In MMS transmission. NOTE: 8. Therefore. The body may contain text (e.4.1 (2011-04) 8. Due to the fact that transcoding is integral part of MMS which is an explicit change of content.g.4].2. The POP3 protocol does not follow the store-and-forward approach because it is not capable to push (i.1.g.2 Reference content An e-mail consists of a header and a body. POP3 (Post Office Protocol.23 ETSI TS 102 250-3 V2. archives. see [i. see [i.3. For the time being.1 Protocols The following protocols by the present procedure: • For upload: • SMTP (Simple Mail Transfer Protocol).3].4 8. For download: IMAP4 (Internet Message Access Protocol. transcoding may be used by the MMS infrastructure to adapt content from the format of the sending UE to a format supported by the receiving UE.).1. see [i. version 4). 8.
In case that a commercial client is used for testing not all of the pauses defined in clause 8.4.7 General requirements and limitations The used e-mail client should be comparable to popular e-mail clients used by customers in respect of behaviour and performance. 8.2]. The measured values of all QoS parameters except for the access related QoS parameters depend on the e-mail content used.6 Timeouts Every QoS parameter has its own configurable timeout setting which depends on the reference content and the technology used.1 (2011-04) In addition the measurements should not be influenced by additional (unwanted) or old e-mails.4. 8.1. e-mails of the same size). Please refer to Part 5 for timeout settings. 8.3 Content integrity After each e-mail transfer it should be checked if the transferred reference content is received completely and is identical to the original data (including attachments).1. Please refer to Part 5 [3] for more details on the reference content to be used for e-mail testing. Therefore it is only allowed to aggregate test results which used the same e-mail content setup. Authentication mode used.1. Each e-mail uploaded shall have a unique identifier inside the e-mail header for unambiguous identification. The following information shall be logged: • • • Type of e-mail client used (including version number. Please refer to [i. junk filter. ETSI .4. 8.4. Each e-mail uploaded shall have a unique test probe identifier inside the e-mail header to identify the uploading system.g. This unique identifier can be used for the aggregation of test results using the same setup (e.1. The performance of the used server should be comparable to commercially used systems.2 may be user configurable. cleanup of e-mail accounts).4 Push functionality Both the client and the server shall support push functionality ("idle" feature) for tests using the IMAP4 protocol. 8.24 ETSI TS 102 250-3 V2.4.1. except for the access-related QoS parameters. Appropriate measures should be taken (e.2. build. Each e-mail downloaded shall have a unique identifier inside the e-mail header and the e-mail body for unambiguous identification.g.4. maximum number of parallel sockets).5 Header only download The e-mail client used shall support the feature of downloading only the header of an e-mail contained within the inbox. For e-mail upload additional procedures are necessary to guarantee the integrity of the transferred content. This is needed when different systems are uploading e-mails to a commonly used receiving account.
2. Configurable pause (default 15 s).g.4. Attempt to upload up to e. Login client A to server A. Configurable pause (default 15 s) before starting the next test sequence.1 Upload scenario The upload test cycle is defined as follows: 1) 2) 3) 4) 5) 6) 7) Connect to the mobile network (set up IP connectivity). 8. ten e-mails to server A. Disconnect from the mobile network. Download scenario.1 (2011-04) 8. Configurable pause (default 15 s).2 1) 2) 3) Transaction scenarios for e-mail Upload scenario. Client A Server A < Connect to mobile network > Client connects to server Upload e-mail 1 Upload e-mail 2 Upload e-mail 10 < Disconnect from mobile network > Figure 3 ETSI … .4.2. The third scenario tests the complete service chain. with a configurable pause (default 15 s) after each upload. while the second one only examines the download path. End-to-end scenario. The following transaction scenarios are possible to test the service from an end customer perspective: The first scenario only considers uploading an e-mail. from the sending an e-mail by the A-party to the reception of the e-mail by the B-party.25 ETSI TS 102 250-3 V2.
g. with a configurable pause (default 15 s) after each download. Client A Server A < Connect to mobile network > Client connects to server Download e-mail header 1 Download e-mail header 10 Download e-mail 1 Download e-mail 10 < Disconnect from mobile network > Figure 4 … … 8. Attempt to download up to e. Configurable pause (default 15 s).2 Download scenario The download test cycle is defined as follows: 1) 2) 3) 4) 5) 6) 7) 8) 9) Connect to the mobile network (set up IP connectivity).2.2. ten e-mail header from server A. ETSI .3 End-to-end scenario with IMAP4 For the end-to-end scenario it is necessary to point out the dependency of the measurement of the download parameters from the e-mail upload: Only in case of a successful upload by the A-party will the B-party be able to download the incoming e-mail (either by polling the inbox or after having received a notification from the e-mail server).g. Configurable pause (default 15 s) before starting the next test sequence. Configurable pause (default 15 s). Attempt to download all e. Configurable pause (default 15 s).2. Disconnect from the mobile network. Login client A to server A. with a configurable pause (default 15 s) after each download.1 (2011-04) 8.4. ten e-mails from server A.26 ETSI TS 102 250-3 V2.4.
1 Common aspects Transaction definition and transaction types for data measurements A transaction consists of access to a server to obtain content which is a closed unit from the user's perspective. While the process of obtaining a connection is different between circuit-switched and packet-switched access.1.5 SDS Definitions for SDS are for further study. data measurements for internet-related services are described. with a configurable (default 15 s) pause after each upload. or a web-site viewing access which may consist of several single objects which form the desired web page to be viewed. Configurable pause (default 15 s).27 ETSI TS 102 250-3 V2. Server B notifies client B of a new incoming e-mail. Upload phase: 1) 2) 3) 4) 5) Client A connects to server A. Configurable pause (default 15 s) before starting the next test sequence. Upload up to ten e-mails to the server. ETSI .1 (2011-04) The end-to-end test cycle is defined as follows: Initialisation phase: 1) 2) 3) A-party and B-party connect to the mobile network (set up IP connectivity). 9. 1) Attempt to download all notified e-mails. Configurable pause (default 15 s) before starting the next test sequence.2. there are many similarities for the actual data transfer phase. 9 Data measurements In the following clauses. Download phase: This phase runs in parallel to the notification phase. Configurable pause (default 15 s). e. client B then waits for incoming notifications. 1) 2) Client B is notified of incoming e-mails by server B and initiates the header download.1 9. a single downloaded file. Login client B to server B logs.g. 8. Disconnect phase: 1) 2) A-party and B-party disconnect from the mobile network. Notification-Phase This phase runs in parallel to the upload phase. Disconnect from the mobile network.
such control may exist. With E-mail and FTP (assuming appropriate access privileges).1. The degree of control a testing system has further depends on the type of service. when testing internet services.g.1 (2011-04) 9. At the same time. or make sure that all networks under test are affected the same way. the following outer conditions need to be constant throughout a testcase: • Access timing including behaviour in case of failure to obtain IP access. accounts used by the test system are valid.g.g. for in activity over a certain period of time. Test design must ensure that such effects are excluded from QoS assessment.1 Transaction phase and parameter overview General To ensure comparability and statistical validity of transactions. Meaningful tests therefore shall contain appropriate measures to exclude such effects from QoS assessment.g. content of popular web portals) and therefore performance tests may give varying results over time. in particular. User's point of view typically includes assumptions of a time the user is ready to wait before an action is considered to be failed. technically feasible set of parameters. Additional attempts e.2.g.g.1.3 Test data content When using web content (web sites or single pages) for testing. IP service access typically goes with timeout windows at several levels. it must be taken into account that such content will typically change frequently (e. and performance will be affected by third-party traffic. Typically. e. Preferably. In case of B-servers and C-servers. It is assumed that such tests are performed by fixed network units. This type of counterpart shall be termed B-Servers. in particular if IP access occurs intra-network. Cyclical access-time tests.4. for FTP). It is assumed that A-servers are generally outside the sphere of control of testing systems.1. in the GGSN domain). A-access for access to an A-server. give positive login. it is assumed that data service access is made to a server or entity within the general internet domain: • • Third-party content in the public internet. no baseline information for load or other conditions is obtainable. • Access to a particular type of server will be termed using the same letter. We will term this type of counterpart A-Servers. Suggested methods are: • • Cyclical availability checks on target servers or domains.g. ETSI . and are good for full access to all activities forming the test.28 ETSI TS 102 250-3 V2. standardized and constant web content shall be used.2 Server types The following categories of servers are distinguished. data content can be determined exactly (e. it is required that all access attempts which form part of the statistics must follow a constant time pattern. Test design must combine these two aspects to a reasonable.g. 9. web domains assigned for testing purposes). Accounts on internet servers which are under control of the testing system or under control of testing personnel (e. for IP-level tracing or non-internet capabilities (e. Special servers not reachable via public internet (e. availability may depend on influences other than those under test.1. This type of counterpart shall be termed C-Servers.4 9. NOTE: This covers read/write privileges and directory-access rights e. by uploading files to be downloaded as part of subsequent tests. e. It is assumed that for services where login is required. UDP testing). or equipped with additional instrumentation e. but will typically be limited in some way due to IP-security reasons. For reasons of comparability in density. 9.g.g. in the case of network or service unavailability must not affect the pattern of the statistically relevant access attempts.
GGSN. it must be taken into account that a useful PDP context is indicated by the system. Logical location of server (public internet. in IP services periods of inactivity can occur with the session still intact. which is in fact not useful.4. Maximum server throughput inbound and outbound.) with respect to effects possibly created by other traffic. per session response per connection. etc. or server IP address Account being used (where appropriate) Content composition and size Pause between access attempts 9. Therefore. Due to possible URL/IP address storage. there may be the situation that while actual data transfer is already running.2 Packet-switched access Table 10: Transaction phase and parameter overview for packet-switched access Phase Internet access Subphase Network access Session access DNS access Domain access Data transfer Cleardown Parameters Equipment Types and Capabilities Type of access used (CSD/PSD.2. On the other hand. UE initialization) APN and other initial settings Access and authentication parameters for basic internet access DNS (in case of non-automatic DNS assignment during session access procedure) Target URL. DNS accesses with dummy URL.1. such as video streaming.1 (2011-04) For services using buffering.3 Circuit-switched access Table 11: Transaction phase and parameter overview for circuit-switched access Phase Internet access Subphase Connection set-up Session access DNS access Domain access Data transfer Cleardown Parameters Equipment Types and Capabilities Parameters for dial-up connection Access and authentication parameters for basic internet access DNS (in case of non-automatic DNS assignment during session access procedure) Target URL. the following general information elements need to be logged in order to ensure reproducibility and comparability of tests: • • • • Operating system (type and version). This period of time shall be considered part of service usage. 9. testing shall include cyclical "lifecheck" measures. the visual appearance is that of still waiting. MTU size. it must be assured that actual DNS access takes place. or server IP address Account being used (where appropriate) Content composition and size Pause between access attempts ETSI . Typically.29 ETSI TS 102 250-3 V2. Independently of the type of access. not if such pings are blocked by the network.1.4. A possible method is ICMP pings to the DNS.
In case of dropped sessions. server name).1 FTP Transaction definition and transaction types for FTP The basic transaction for FTP testing consists of internet access to a FTP server followed by either downloading or uploading a single file of given size.1 (2011-04) 9.2.2 9. it must be assured that the file to be downloaded is actually available on the server. It is understood that basic access procedures such as server login shall not be considered as part of a transaction. a data transaction is termed "session" in contrast to "call" regardless of the type of connection (CS or PS).7 Content integrity Content integrity is correctness and completeness. For the single phases of internet access (as part of general service access). Loss of connection to the server. Loss of internet access: If access to another domain or server is still possible.1. Domain access: This is the actual internet access as seen from the user's perspective. Successful access is assumed when a temporary IP address good for data transactions has been assigned to the testing system.1. Loss of basic IP connection. a successful domain access can be assumed when communication with the target server has been proved. ETSI .2. valid URL. the general result term "dropped" shall be used. If DNS access is still possible after a session loss. For download tests.6 Content quality Content quality relates to the quality as perceived by the user. 9. it shall be assumed that basic internet services are still available.30 ETSI TS 102 250-3 V2.1. leading to "dropped session" for non-completed service usage. the following additional definitions are given: • • • Session access: Access and authentication procedure for basic internet access. Technical precautions should be taken to make sure that the content received is the one expected. 9. 9. it must be assured that no storage-size limitations prevent successful upload. The respective action will depend on the service under test. it is assumed that the basic IP connection is still intact. DNS access: Obtaining an IP address from a URL (web site name. However. Successful DNS access is assumed when an IP address has been obtained from a given. For testing purposes.5 Possible transaction results Commonly. For upload tests. the testing system shall indicate which of the possible principal causes occurred for the purpose of deciding of the network under test is to be blamed or not: • • • • Loss of radio connection.
2. maximum number of parallel socket connections.2 Transaction phase and parameter overview for HTTP Same as family definitions. the following parameters shall be logged: • • • type of FTP client used. 9.4 Content quality for HTTP Same as family definitions.). In addition.31 ETSI TS 102 250-3 V2. type used (active or passive). size of documents.3 9.3. protocol used (TCP/IP or UDP).3.2 Transaction phase and parameter overview for FTP Same as family definitions.2. 9.3.2.2. 9. the following parameters shall be logged: • • Type of browser used (including version number/build). 9. etc. In addition. 9. For test-system browsers.1 HTTP Transaction definition and transaction types for HTTP The basic transaction for HTTP testing consists of internet access followed by downloading a web site for a given URL response of given structure. ETSI .3 Possible transaction results for FTP Same as family definitions.4 Content quality for FTP Same as family definitions.5 Content integrity for FTP Same as family definitions. Reference web site used (structure. 9.2.1 (2011-04) 9. 9.3.3 Possible transaction results for HTTP Same as family definitions. It is recommended to use file size and checksum comparison.
g. A static url e. main page of the WAP-portal (variable WAP content) Picture count and text size have to fulfil minimum requirements depending on the url.g. NOTE 2: The size of the mobile cache can be neglected. Depending on the test goal one of the following clauses should be used: A given reference WAP page (static WAP content) Picture count and text size has to be stable.32 ETSI TS 102 250-3 V2. (see also the Annex of part 5 [3]). NOTE 1: It is required that the WAP page has a size greater than one packet. this leads to the requirement that download times shall only be compared directly if such accelerators are not in the chain. Access-Point (Gateway). The mobile specific effects (rendering) are not represented in case of non application level testing. when reporting such values the fact that different accelerator operation was in effect and that values are not to be compared shall be explicitly emphasized. build).1 (2011-04) 9. 9.4.5. accept-header). recommended method for content integrity checking is to verify that the expected main page has been loaded. in benchmarks) if they are obtained without accelerators (performance enhancement proxies) or with the same accelerator behaviour for all networks involved. In practice.3.1 WAP Transaction definition and transaction types for WAP The basic transaction for WAP testing consists of WAP access and download of a WAP page.4 E-mail Please refer to clause 8. Mobile browser (version number. • It is required that all WAP session attempts follow a constant time pattern. and to verify the expected number of web elements and their respective type. the following parameters have to be logged: • • • • • Protocol (WAP1. Based on the family definition. To guarantee comparability and statistical validity of transactions.0).2. since the exact working of such accelerators is not known. ETSI . QoS parameters shall only be compared directly (e. because all tests should be performed with an empty mobile cache. Otherwise. size and content. Type of mobile used / emulated (user-agent string.x or WAP2. as the procedures described there are usable for direct services as well if notification is disabled on the e-mail server. 9.5 9.5 Content integrity for HTTP It is assumed that a typical HTTP downloaded page consists of a main page and a number of sub-elements contained in this page (web elements).
X) PDP context de-activation PS detach Figure 5 ETSI . Access-Point (Gateway). number of pictures.2 Transaction phase and parameter overview for WAP Same as family definitions. etc. the following parameters shall be logged: • • • • • Protocol (WAP1.5.1 (2011-04) 9.x or WAP2. it is recommended that the following general method should be used. URL of the WAP page.X) WAP IP access (WAP2.0). accept-header. mobile used (user-agent string.0) Transfer the first content-page Request the page Clear the cache Next page ? WAP de-activation (WAP1. browser type).). When measuring the parameter using drive tests or field tests. Technology available (precondition) PS attach (precondition) Clear the cache Request the first page PDP context activation Transfer the page WAP activation (WAP1.2.0) WAP IP access (WAP2.33 ETSI TS 102 250-3 V2. Structure of the WAP page (size of content. In addition.
5.6.4 Content quality for WAP Same as family definitions.1 (2011-04) 9. 9.g. ETSI . 9. 9. • In case of testing a given reference WAP page (static WAP content) the whole (known) content should be verified. recommended method for content integrity checking is to verify that all elements of the expected main page have been completely loaded. OS and relevant configuration of streaming server. 9. the following parameters shall be logged: • • • streaming Server and Client versions used. which may have sub-elements themselves. In case of testing public WAP pages with variable WAP content it is necessary to define and check the page regarding minimum criteria (e.3 Possible transaction results for WAP Same as family definitions. keyword).5.34 ETSI TS 102 250-3 V2. For identifying the content of the requested page it is necessary to check static page content (logo. Based on the family definition. 9.4 Content quality for Streaming Video To be decided.1 Streaming Video Transaction definition and transaction types for streaming video The basic transaction for Streaming Video testing consists of internet access to a Streaming server followed by replay access to a given content from this server. five pictures and text size greater than 150 Byte). In addition.2 Transaction phase and parameter overview for streaming video Same as family definitions. 9. streaming protocol used.6.2.6.5 Content integrity for WAP The following is to verify that the received page is not an "error message" page and that the requested page is downloaded.5.6. It is assumed that a typical WAP downloaded page consists of a main page and a number of sub-elements contained in this page.6 9.5 Content integrity for Streaming video To be decided.3 Possible transaction results for Streaming Video Same as family definitions.6. 9.
Presentation server: May be a Web or WAP "portal". Download is the means by which a media object is delivered to the UE. DRM makes it possible to sell the rights to use the media object. A content provider can grant a user the rights to preview media objects for free and charge the user only for the full usage rights. DRM enables content providers to define rules (rights) for how the media object should be used. Status Report Server: Receives the posted status reports. ETSI . However. This specification defines also a "forward-lock" special case of combined delivery where the DRM message does not contain a rights object. 9.7 9. moving the actual media object from the server to the download agent. The rights can be delivered to the consuming UE by downloading them together with the content or by sending the rights object separately from content.35 ETSI TS 102 250-3 V2.1 (2011-04) 9. Discovery application: The user discovers media objects on the Web by using a WAP browser or applications specifically created for one type of media. It is possible to associate different rights with a single media object. Different rights may have different prices. In that case a set of default rights apply for the media object.7. a complete DRM technology.1 Media Download Transaction definition and types for Media Download There is a need for content providers and operators to control the usage of downloaded media objects. Since the value lies in the rights and not in the media object itself. DRM packager: Is wrapping media objects into DRM containers and is also responsible for generating the rights. DRM Agent: Handles DRM media objects. Download server: Is responsible for the download transaction. The former case (combined delivery) is simpler whereas the latter case (separate delivery) provides more security by making it more difficult to steal the content. rather than selling the media object itself.2. Digital Rights Management (DRM) is the means to control the usage of the media object once it has been downloaded.1. Download agent: Launched after the discovery application downloaded the download descriptor and handles the remaining part of the download. including strong security between the consumer UEs and content providers is not in the scope of OMA Download.1 OMA network elements Figure 6 Download descriptor can be located on either the presentation server or the download server. The OMA Digital Rights Management follows common DRM practices taking into account the special requirements and characteristics of the mobile domain in order to support basic functionality with some level of security.7.
When this case ends. Because the media object and the download descriptor are both delivered together. a status report is posted to a URL specified in the download descriptor.by selecting a link in a Web page.g.1 (2011-04) 9. Main scenario: 1) 2) 3) 4) 5) 6) 7) User initiates a GET request to the URL . a status report is posted to the specified URL. ETSI .2.7. and sends a GET response back to client. the media object is available on the device.2. Client sends GET request to the server and waits for a response. the URL must also be available on the device to the user (e.2 9. In the combined OMA download use case a media object and a download descriptor is downloaded from an HTTP server by using one GET request and response. from the server. The information in the download descriptor is presented to the user.1 OMA download use cases Combined OMA download use case Figure 7 The OMA download use cases extend the basic HTTP download use case by using a download descriptor. Client accepts GET response.g. The media object is made available to the user (e.7. the media object and the corresponding download descriptor is packaged into one multipart entity available on an HTTP URL. if the main scenario is completed. for example. Optionally. the multipart with the media object and the download descriptor.1. If the download descriptor indicates that a status report shall be posted. with the HTTP headers and the data. the user is unable to confirm the download before the delivery of the media object. saved on the file system).36 ETSI TS 102 250-3 V2. Server serves up the requested resource. as a link in a WAP page). When this use case starts.1.
for example. Main scenario: 1) 2) 3) 4) 5) 6) 7) 8) User initiates a GET request to the URL . When this case ends. HTTP download is used to deliver the media object.by selecting a link in a Web page.g. from the server. Optionally. The user is able to confirm the download based on pre-download capability checks in the device.1. with the HTTP headers and the data. the media object and download descriptor are available on two separate HTTP URLs. the download descriptor URL must also be available on the device to the user (e. ETSI .37 ETSI TS 102 250-3 V2. When this use case starts. the media object is available on the device. and via a device specific download user interface.1 (2011-04) 9. The information in the download descriptor is analysed by the UE (capability checks) and user is given a chance to confirm the download. The media object is made available to the user (e. saved on the file system).7. Client accepts GET response. If the download descriptor indicates that a status report shall be posted. The media object URL is available on the download descriptor. if the main scenario is completed. Server serves up the requested resource.2 Separate OMA download use case Figure 8 In the Separate OMA download use case a media object and a download descriptor is downloaded from an HTTP server by using two GET request and response.2.2. a status report is posted to the specified URL. as a link in a WAP page). and sends GET response back to client. a status report is posted to a URL specified in the download descriptor. the download descriptor.g. Client sends GET request to the server and waits for a response.
The DRM message is made available to the UE (e. using a DRM packager. using a DRM packager.2 Separate delivery DRM use case Figure 10 A protected media object is downloaded from an HTTP server.1 (2011-04) 9. The DRM content format URL is made available to the UE (e. by publishing it on a Web page). 9.3 9. over SMS).1. packages the media object and the rights object into one DRM message. The key to decrypt the media object is put into the rights object. Later.3.1 DRM use cases Combined delivery DRM use case Figure 9 A protected media object. The user is using the media object and the DRM agent ensures that it is used according to the rights. It can be used only according to the granted usage rights.38 ETSI TS 102 250-3 V2. The user waits for the rights object to be delivered via a WAP Push message from the content provider. (If OMA download was used.2. It can be used only according to the granted usage rights. Main scenario: The content provider. HTTP download or OMA download is used to deliver the DRM content format.7. HTTP Download or OMA Download is used to download the DRM message (media and rights object). the media object is available on the UE. by publishing it on a Web page).g.7.1. ETSI . if the main scenario is completed. Main scenario: The content provider.g.g. When this case ends. The rights object is not available to the UE.7.1. The media object is decrypted using the key from the rights. is downloaded from an HTTP server.3. packages the encrypted media object into a DRM content format. the corresponding rights object is delivered to the UE via WAP Push (e. the media object is available on the UE. The user is using the media object and the DRM agent ensures that it is used according to the rights. if the main scenario is completed. When this case ends. together with the corresponding rights object. the status report could be used as a "trigger" in the network to push the rights object to the UE. after a successful download of the encrypted media object).
1 Figure 11 For the download part the marked WAP or equivalent HTTP parameters should be used.1 (2011-04) 9.7.39 ETSI TS 102 250-3 V2.7.1 Transaction phase and parameter overview for Media Download Overview of basic parameters for Media Download Charts in Figure 11 (taken from [3]) show on which basic parameters the Media Download service sequence is based. the marked Store and Forward (S&F) parameters should be used.2.2 9. ETSI .2. t2 See end of message upload at A-party side Reception of final acknowledgement for the last data packet containing content t3 t4 Notification download starts t5 Reception of the first data packet containing notification content See first incoming notification data at B-party side t6 Notification is received See notification is received at B-party side t7 Client requests the message Start further message download at B-party side t8 Reception of the first data packet containing message content See incoming message data at Bparty side t9 Message is received completely at B-party side See complete message at B-party side technical trigger points t1 for success cases trigger points customer's view Notification Start FR B-party side See start of notification download at B-party side Notification Download Access FR Notification Download IP Access Time Notification Data Transfer Cut-off Ratio Notification Data Transfer Time Message Download Access FR Message Download Access Time Message Download Data Transfer Cut-off Ratio Message Download Data Transfer Time Notification Start Time 2 parameters Notification Download FR Notification Download Time Message Download FR Message Download Time Notification and Message Download FR Notification and Message Download Time End-to-End Failure Ratio End-to-End Time NOTE: FR: Failure Rate Figure 12 For the DRM separate delivery part. Message Upload FR Message Upload Time Message Upload Access FR Message Upload Access Time A-party side trigger points Push "Send" customer's message button at A-party side view First data packet is uploaded by the Aparty side parameters Message Upload Data Transfer Cut-off Ratio Message Upload Data Transfer Time See start of message upload at A-party side Upload of the first data packet containing content.
2. Technical description / protocol part Start: • Same as WAP/HTTP (Stop from B) Stop: • Same as WAP/HTTP (content: Media and DRM Object) E: Media Object and Download Descriptor Trigger point from user's point of view Start: Appearance of the payment receipt page Stop: Media file download is completed Technical description / protocol part Start: • Same as WAP/HTTP (Stop from A) Stop: • Same as WAP/HTTP (content: Media Object and Download Descriptor) F: Media and DRM Object and Download Descriptor Trigger point from user's point of view Start: Appearance of the payment receipt page Stop: Media file download is completed. Stop: Media File download is completed. Technical description / protocol part Start: • Same as WAP/HTTP (Stop from A) Stop: • Same as WAP/HTTP (content: Media and DRM Object and Download Descriptor) ETSI .40 ETSI TS 102 250-3 V2.7. Stop: Media file download is completed.2. Stop: Payment receipt page is successfully loaded within the specified time limit. A: Purchase Link Trigger point from user's point of view Start: Select download purchase link. The information includes the basic parameters used and the trigger points they are based on. Technical description / protocol part Start: • Same as WAP/HTTP Stop: • Same as WAP/HTTP (content: payment receipt page) B: Download Descriptor Trigger point from user's point of view Start: Appearance of the payment receipt page.1 (2011-04) 9.2 Media Download subphases The following text boxes are providing subphase specific information about the whole Media Download service sequence. Technical description / protocol part Start: • Same as WAP/HTTP (Stop from B) Stop: • Same as WAP/HTTP (content: Media Object) D: Media and DRM Object Trigger point from user's point of view Start: Push download button. Stop: Media file data page is successfully loaded. Technical description / protocol part Start: • Same as WAP/HTTP (Stop from A) Stop: • Same as WAP/HTTP (content: Download Descriptor) C: Media Object Trigger point from user's point of view Start: Push download button.
4 Separate OMA download and combined delivery DRM use case The following overview chart illustrates the minimum combination of subphases for a Media Download service sequence in case of separate OMA download and combined delivery DRM use case.7.D. Stop: Downloaded file is successfully saved or installed within the specified time limit.41 ETSI TS 102 250-3 V2.7. 1 A 1 F Figure 13 1 G 9.7.1 (2011-04) G: Install Notify Trigger point from user's point of view Start: Push save or install button if content is not saved automatically.2.5 Combined OMA download and separate delivery DRM use case The following overview chart illustrates the minimum combination of subphases for a Media Download service sequence in case of combined OMA download and separate delivery DRM use case.2.2. 1 A 1 B 1 D 1 G Figure 14 9. 1 A 1 E 1 G Figure 15 2 H ETSI .E or F) Stop: • Sending of the Install Notify message H: DRM Object Trigger point from user's point of view Start: Downloaded file is successfully saved or installed within the specified time limit. Technical description / protocol part Start: • Same as WAP/HTTP (Stop from C.3 Combined OMA download and combined delivery DRM use case The following overview chart illustrates the minimum combination of subphases for a Media Download service sequence in case of combined OMA download and combined delivery DRM use case. Stop: DRM Message is received Technical description / protocol part Start: • Sending of the Install Notify (Stop from G) Stop: • Same as Store and Forward 9.2.
7.7. 9. it is recommended that for example the general WAP method should be used.42 ETSI TS 102 250-3 V2. Test objects for Media Download should not be reported to chart ranking agencies and billed with real costs. Media Download Session Failure Ratio over all subphases.4 NOTE: Content quality for Media Download On application layer the content quality for Media Download could be evaluated by playback of downloaded media. ETSI .8 NOTE: Recommended Testing Method for Media Download Frequently usage of public content can take influence on official chart rankings. Same as family definitions (WAP/HTTP/Store and Forward).2. Media Download Session Time as sum over all subphase times (whole sequence/session was successful).1 (2011-04) 9. Media object information: Artist. When measuring the parameters using drive tests or field tests.7. title.2.3 Possible transaction results for Media Download Same as family definitions (WAP/HTTP/Store and Forward). Purchase of an already purchased song can change the service sequence. the following information should be logged: • • Use case information.2. format and size.7 Additional information about parameters for Media Download Same as family definitions (WAP/HTTP/Store and Forward).7. 1 A 1 B 1 C Figure 16 1 G 2 H 9.2.6 Separate OMA download and separate delivery DRM use case The following overview chart illustrates the minimum combination of subphases for a Media Download service sequence in case of Separate OMA download and separate delivery DRM use case. 9. In case of separate delivery DRM use case the SMS memory should be erased before sequence start and checked at the end of service sequence.7. In addition. Media Download Session Failure Ratio over all subphases. They should be endlessly purchasable without impact on service sequence. 9. Media Download Session Time as sum over all subphase times (when whole sequence/session was successful).
ETSI .7.43 ETSI TS 102 250-3 V2. Same as family definitions (WAP/HTTP/Store and Forward).2.1 (2011-04) 9.5 NOTE: Content integrity for Media Download On application layer the content integrity for Media Download could be evaluated by playback of downloaded media.
1 V2.1 V1.2 V1.44 ETSI TS 102 250-3 V2.1 October 2003 March 2004 February 2005 April 2005 September 2005 December 2008 August 2010 April 2011 Publication (Withdrawn) Publication (Withdrawn) Publication (Withdrawn) Publication Publication Publication Publication Publication ETSI .1 V1.4.3.3.2.1 V2.1 (2011-04) History Document history V1.1 V1.2.1.2.5.1 V1.1.
Documents Similar To TS 102 250-3 - V2.2.1
00_CN3138-01A Service Description
17-SGSN-Admin.pdf
Inter Rat Naccsa
ts_129002v031100p
Engineering Project Recommendations(20)
Wcdma Arch,Channel,Handover
BSSGP layer.docx
Dictionary of Non-Functional Requirements
LoRa vs IoT-NB
BSC&RNC Performance Monitoring
An Effective Cloud Service Reservation Through Negotiation
Iptps06 Skype
More From Hoài Hà
Dien Dep
thesisguidelineDTVT