Abstract:
Various communication systems may benefit from methods, apparatuses, and systems for data collection. For example, wireless communication systems of the third generation partnership project (3GPP) may benefit from data collection in network management layer coverage and capacity optimization. For example, a method may include sending performance measurement job activation indicating that minimization of drive test data is to be collected (in an alternative, the job can be configured to indicate that non-MDT data is to be collected). The method may also include receiving performance measurements in response to the job activation.

Description:
CROSS-REFERENCE TO RELATED APPLICATION 
       [0001]    The present application is related to and claims the benefit and priority of U.S. Provisional Patent Application No. 61/828,133, filed May 28, 2013, the entirety of which is hereby incorporated herein by reference. 
     
    
     BACKGROUND 
       [0002]    1. Field 
         [0003]    Various communication systems may benefit from methods, apparatuses, and systems for data collection. For example, wireless communication systems of the third generation partnership project (3GPP) may benefit from data collection in network management layer coverage and capacity optimization. 
         [0004]    2. Description of the Related Art 
         [0005]    Self-organizing networks (SON) network manager (NM) centralized coverage and capacity optimization (CCO) in third generation partnership project (3GPP) may relate to optimizing the coverage and capacity issues, based on the data, including measurements and events, reported from the network elements (NEs) via element manager (EM)/domain manager (DM). 
         [0006]    The NM CCO use cases can include a downlink coverage map use case, a long term evolution (LTE) connection failure use case, cell coverage adapting to traffic demand use case, coverage and accessibility use case, LTE coverage holes with underlaid universal terrestrial radio access network (UTRAN)/global system for mobile communication (GSM) enhanced data rates for GSM evolution (EDGE) Radio Access Network (GERAN) use case, and a radio link quality use case. 
         [0007]    The data to support NM CCO can include minimization of drive test (MDT) measurements, both UE and network side measurements, collected on a per-UE basis. The data to support NM CCO can also include RSRP, RSRQ, location info, IP throughput, and the like. Moreover, the data to support NM CCO can include RLF reports, RCEF reports, and CQI/RI distribution. 
         [0008]    To save the effort of data correlation at the NM layer and to avoid the privacy issues with minimization of drive test data, conversion of minimization of drive test data, like reference signal received power (RSRP) and reference signal received quality (RSRQ), into new performance measurements (PMs), and the reporting of these performance measurements to the NM, are discussed in third generation partnership project (3GPP) technical report (TR) 32.836, “Enhanced CCO Study,” which is hereby incorporated herein by reference in its entirety. 
         [0009]    However, some performance measurements, like RSRP and RSRQ histograms, may be defined with the purpose of supporting some very specific use cases. Such performance measurements are not necessarily triggered by the minimization of drive test functionality. Also, the triggers of measurement collection may also be different. For example, some cases may need periodic user equipment (UE) measurements, while other cases may just need event based UE measurements. For example, to support a downlink coverage map, histogram, use case, a full picture may be desired. Thus, it may be necessary to have the measurements report for all location tiles, which may imply measurement collection from every connected UE. The UE periodic trigger for measurements collection may be appropriate for this case. 
         [0010]    For some other cases, for example addressing the cell edge, reports may be only needed from some certain UEs whose measurements met the thresholds conditions. For such cases, event based trigger for measurements collection with certain thresholds may be appropriate. 
         [0011]    Thus, by converting the minimization of drive test data into performance measurements, the final results an operator gets may be a mixture of measurements collected with periodic and event based triggers, and the generated performance measurements may not be useful or optimal for both purposes. For example, by periodic collection the number of UEs with RSRP in range−1 (−60, −55) dbm is 4, in range−2 (−55, −50) dbm is 3, but if you set the threshold for event based collection above −55 dbm then you cannot get the reports in the same range, but it does not mean that the real number UEs in this range−1 is 0, and you may get value is 2 in event based measurement collection for range−2. If you mix them together you will get the value for this range−1 is 4, range-2 is 5, but they are comparable. 
         [0012]    Trace Integration Reference Point (IRP) can be used for triggering the minimization of drive test measurements collection for conversion into PM. The trigger mechanism of minimization of drive test data collection, however, is not conventionally defined. 
       SUMMARY 
       [0013]    According to certain embodiments, a method may include sending performance measurement job activation indicating that minimization of drive test data is to be collected (in an alternative, the job can be configured to indicate that non-MDT data is to be collected). The method may also include receiving performance measurements in response to the job activation. 
         [0014]    In certain embodiments, a method may include receiving performance measurement job activation via a performance measurement interface from a manager indicating that an agent is to collect minimization of drive test data. The method may also include performing performance measurement collection with respect to a network element. The method may further include receiving performance measurements or measurement reports from the network element. The method may additionally include providing the performance measurements to the manager. 
         [0015]    A method, according to certain embodiments, may include receiving a request for performance measurements from an agent. The method may also include receiving measurement reports of minimization of drive test data corresponding to a plurality of user equipment. The method may further include converting user equipment measurement reports to performance measurements. The method may additionally include transmitting the performance measurements to the agent. 
         [0016]    An apparatus, in certain embodiments, may include at least one processor and at least one memory including computer program code. The at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to send performance measurement job activation indicating that minimization of drive test data is to be collected (in an alternative, the job can be configured to indicate that non-MDT data is to be collected). The at least one memory and the computer program code can also be configured to, with the at least one processor, cause the apparatus at least to receive performance measurements in response to the job activation. 
         [0017]    According to certain embodiments, an apparatus can include at least one processor and at least one memory including computer program code. The at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to receive performance measurement job activation via a PM interface from a manager indicating that an agent is to collect minimization of drive test data. The at least one memory and the computer program code can also be configured to, with the at least one processor, cause the apparatus at least to perform performance measurement collection with respect to a network element. The at least one memory and the computer program code can further be configured to, with the at least one processor, cause the apparatus at least to receive performance measurements or measurement reports from the network element. The at least one memory and the computer program code can additionally be configured to, with the at least one processor, cause the apparatus at least to provide the performance measurements to the manager. 
         [0018]    In certain embodiments, an apparatus can include at least one processor and at least one memory including computer program code. The at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to receive a request for performance measurements from an agent. The at least one memory and the computer program code can also be configured to, with the at least one processor, cause the apparatus at least to receive measurement reports of minimization of drive test data corresponding to a plurality of user equipment. The at least one memory and the computer program code can further be configured to, with the at least one processor, cause the apparatus at least to convert user equipment measurement reports to performance measurements. The at least one memory and the computer program code can additionally be configured to, with the at least one processor, cause the apparatus at least to transmit the performance measurements to the agent. 
         [0019]    An apparatus, according to certain embodiments, may include means for sending performance measurement job activation indicating that minimization of drive test data is to be collected (in an alternative, the job can be configured to indicate that non-MDT data is to be collected). The apparatus may also include means for receiving performance measurements in response to the job activation. 
         [0020]    An apparatus, in certain embodiments, can include means for receiving performance measurement job activation via a PM interface from a manager indicating that an agent is to collect minimization of drive test data. The apparatus can also include means for performing performance measurement collection with respect to a network element. The apparatus can also include means for receiving performance measurements or measurement reports from the network element. The apparatus can further include means for providing the performance measurements to the manager. 
         [0021]    According to certain embodiments, an apparatus may include means for receiving a request for performance measurements from an agent. The apparatus may also include means for receiving measurement reports of minimization of drive test data corresponding to a plurality of user equipment. The apparatus may further include means for converting user equipment measurement reports to performance measurements. The apparatus may additionally include means for transmitting the performance measurements to the agent. 
         [0022]    In certain embodiments, a computer-readable medium (for example, a signal or a non-transitory computer readable medium) can be encoded with instructions that, when executed in hardware, perform a process. The process can include sending performance measurement job activation indicating that minimization of drive test data is to be collected (in an alternative, the job can be configured to indicate that non-MDT data is to be collected). The process can also include receiving performance measurements in response to the job activation. 
         [0023]    A computer-readable medium (for example, a signal or a non-transitory computer readable medium), according to certain embodiments, can be encoded with instructions that, when executed in hardware, perform a process. The process can include receiving performance measurement job activation via a PM interface from a manager indicating that an agent is to collect minimization of drive test data. The process can also include performing performance measurement collection with respect to a network element. The process can further include receiving performance measurements or measurement reports from the network element. The process can additionally include providing the performance measurements to the manager. 
         [0024]    A computer-readable medium (for example, a signal or a non-transitory computer readable medium), in certain embodiments, may be encoded with instructions that, when executed in hardware, perform a process. The process can include receiving a request for performance measurements from an agent. The process can also include receiving measurement reports of minimization of drive test data corresponding to a plurality of user equipment. The process can further include converting user equipment measurement reports to performance measurements. The process can additionally include transmitting the performance measurements to the agent. 
         [0025]    A system according to certain embodiments may include a first apparatus, a second apparatus, and a third apparatus. The first apparatus may include means for sending performance measurement job activation indicating that minimization of drive test data is to be collected (in an alternative, the job can be configured to indicate that non-MDT data is to be collected). The first apparatus may also include means for receiving performance measurements in response to the job activation. The second apparatus may include means for receiving performance measurement job activation from the first apparatus indicating that the second apparatus is to collect minimization of drive test data. The second apparatus may also include means for performing performance measurement collection with respect to the third apparatus. The second apparatus may further include means for receiving performance measurements or measurement reports from the third apparatus. The second apparatus may additionally include means for providing the performance measurements to the first apparatus. The third apparatus may include means for receiving a request for performance measurements from the second apparatus. The third apparatus may also include means for receiving measurement reports of minimization of drive test data corresponding to a plurality of user equipment. The third apparatus may further include means for converting user equipment measurement reports to performance measurements. The third apparatus may additionally include means for transmitting the performance measurements to the second apparatus. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0026]    For proper understanding of the invention, reference should be made to the accompanying drawings, wherein: 
           [0027]      FIG. 1  illustrates a performance measurement (PM) Interface Reference Point (IRP) being used to collect performance measurements converted from minimization of drive test (MDT) data, according to certain embodiments. 
           [0028]      FIG. 2  illustrates a performance measurement interface being used to collect performance measurements converted from MDT data, according to certain further embodiments. 
           [0029]      FIG. 3  illustrates a performance measurement interface being used to collect performance measurements converted from MDT data, according to additional embodiments. 
           [0030]      FIG. 4  illustrates a method according to certain embodiments. 
           [0031]      FIG. 5  illustrates another method according to certain embodiments. 
           [0032]      FIG. 6  illustrates a system according to certain embodiments of the invention. 
           [0033]      FIG. 7  illustrates a system architecture. 
       
    
    
     DETAILED DESCRIPTION 
       [0034]    Certain embodiments provide a mechanism to trigger the collection of data for coverage and capacity optimization (CCO) over the interface Itf-N, in order to ensure that the data can be used by corresponding use cases respectively. The interface Itf-N can connect a network manager (NM) with a subordinate entity, which may be an element manager (EM) or a network element (NE), as described in 3GPP technical specification (TS) 32.600 V10.0.0, which is hereby incorporated herein by reference in its entirety. 
         [0035]      FIG. 7  illustrates an architecture of a system that may be used in connection with certain embodiments. As shown in  FIG. 7 , a network manager (NM)  710  may include a CCO function  715 . Moreover, NM  710  may be connected to task control element (TCE)  720 . NM  710  may also be connected, via interface Itf-N, to domain manager (DM)  730 , which may include an element manager  735 , and to eNB  740 , which may include an element manager  745 . 
         [0036]    DM  730  and eNB  740  can each be connected to eNB  750 . The connection between eNB  740  and eNB  750  may be an X2 interface. Likewise, eNB  750  can be connected to eNB  760  over an X2 interface. The TCE  720  can be connected to DM  730  and eNB  760 . Moreover, DM  730  may be connected to eNB  750  and eNB  760 . Each of the eNBs may be connected to one or more UE. For example, eNB  750  is illustrated as connected to UE  770 . 
         [0037]    According to a first embodiment, measurement triggering can be performed via area-based minimization of drive test activation.  FIG. 1  illustrates a performance measurement (PM) Integration Reference Point (IRP) being used to collect performance measurements converted from minimization of drive test (MDT) data. 
         [0038]    As shown in  FIG. 1 , at  1 , NM/IRPManager  110  can create a measurement job via a performance measurement interface, indicating it is to collect minimization of drive test data. This may be done, for example, by tagging “.MDT” in the measurement name or by selecting a standardized measurement implying that minimization of drive test data will be used. Other ways of indicating are also permitted. 
         [0039]    At  2 , the EM/IRPAgent  120  can recognize that PM measurement requires minimization of drive test data collection or per-UE minimization of drive test network-side data collection. Specific minimization of drive test measurements may be standardized as part of the PM. The EM/IRPAgent  120  can activate area-based minimization of drive test jobs with one or more NE  130 . The activation can follow a proprietary format. The minimization of drive test job activation may indicate that the raw minimization of drive test data is not needed at the task control element (TCE) and is to be converted into PMs. 
         [0040]    Another option may be normal area-based minimization of drive test activation with EM specified as TCE. 
         [0041]    At  3 , the NE  130  can collect minimization of drive test data from UE, including sending measurement configuration, for example periodic measurements collection, to UEs and receiving measurements reports from UEs. 
         [0042]    At  4 , the NE  130  may or may not be able to convert the minimization of drive test data to PM, depending for example on the implementation. If the NE  130  can convert the MDT data, then the process may proceed to  4   b   1 , but otherwise it may proceed to  4   a.    
         [0043]    At  4   a , the NE  130  can send the raw minimization of drive test data to EM/IRPAgent  120 . This can be considered normal NE  130  behavior for an area-based minimization of drive test job. A full anonymization option may need to be selected to avoid communication between NE  130  and a mobility management entity (MME) for each new trace recording session. 
         [0044]    At  4   a   1 , EM/IRPAgent  120  can convert the minimization of drive test data to PM. Alternatively, at  4   b   1 , NE  130  can convert the minimization of drive test data to PM. Then, at  4   b   2  the NE  130  can send the performance measurements converted from minimization of drive test data. 
         [0045]    At  5 , the EM/IRPAgent  120  can send the performance measurements converted from minimization of drive test data to the NM/IRPManager  110 . 
         [0046]    In a second embodiment, measurement triggering can be via measurement job creation.  FIG. 2  illustrates a performance measurement interface being used to collect performance measurements converted from MDT data, according to certain further embodiments. 
         [0047]    As shown in  FIG. 2 , at  1 , NM/IRPManager  110  can create a measurement job via a performance measurement interface, indicating minimization of drive test data is to be collected. This indication may be done, as mentioned above, by tagging “.MDT” in the measurement name or by selecting a standardized measurement implying that minimization of drive test data will be used. 
         [0048]    At  2 , EM/IRPAgent  120  can send the measurements job to one or more NE  130 . The NE  130  can, at  3 , recognize that the specific measurement specified in the measurement job requires minimization of drive test data collection from the UEs or per UE minimization of drive test network side data collection. The specific minimization of drive test measurements may be standardized as part of the PM. The NE  130  can trigger either periodic measurements collection or event triggered measurement collection to all connected UEs in the collection period and can receive the measurements reports from UEs. 
         [0049]    At  4 , NE  130  can convert the minimization of drive test data to PM. The NE  130  can, at  5 , send the raw measurements from UEs or can send performance measurements based on the raw measurements to EM/IRPAgent  120 . Finally, the EM/IRPAgent  120  can send the performance measurements to NM/IRPManager  110 . 
         [0050]    The following is an example performance measurement definition to identify that the performance measurement is converted from minimization of drive test data. The definition is an option of certain embodiments, and is simply one example of a definition that may be used. This definition can be directed to RSRP related measurements converted from minimization of drive test data. 
         [0051]    The measurement can be defined as providing the distribution of evolved UTRAN (E-UTRAN) RSRP. This measurement can be converted from minimization of drive test data (RSRP) by periodic collection of UE measurements. This measurement may only count the periodic measurement reports from UEs rather than the event based measurement reports. 
         [0052]    The measurement can be defined in terms of a cumulative counter (CC). Other counter types are also permitted, as discussed in 3GPP TS 32.404, the entirety of which is hereby incorporated herein by reference. 
         [0053]    Receipt by the eNodeB of minimization of drive test data report can be defined to be via a MeasurementReport message indicating a periodic UE measurement report, in which an information element (IE) MeasResults field includes rsrpResult. This measurement can be increased for each reported value RSRP_LEV, similar to what is discussed in 3GPP TS 36.331, which is hereby incorporated herein by reference in its entirety. This measurement shall be increased for each reported value RSRP_LEV. For example, for every one or two or 17 or 20 RSRP_LEV(s) a separate measurement can be defined similarly to what is discussed in 3GPP TS 36.214, which is hereby incorporated herein by reference in its entirety. 
         [0054]    Each measurement can be defined to be an integer value. Moreover, the respective measurement reports can be defined as MR.Rsrp.y, where y is an integer from 00 to 47. For example, 00 of y can indicate from RSRP_LEV_00 to RSRP_LEV_LEV_20, namely RSRP&lt;−120 dBm. Likewise, 01 of y can indicate RSRP_LEV_21 and RSRP_LEV_25, namely −120≦RSRP&lt;−115 dBm, 02 of y can indicate RSRP_LEV_26, namely −115≦RSRP&lt;−114 dBm, and 03 of y can indicate RSRP_LEV_27, namely −114≦RSRP&lt;−113 dBm. This series can similarly continue on. For example, 36 of y can indicate RSRP_LEV_60, namely −81≦RSRP&lt;−80 dBm, 37 of y can indicate RSRP_LEV_61, RSRP_LEV_62, namely −80≦RSRP&lt;−78 dBm, and 38 of y can indicate RSRP_LEV_63, RSRP_LEV_64, namely −78≦RSRP&lt;−76 dBm. Finally, 46 of y can indicate from RSRP_LEV_79 to RSRP_LEV_80, namely −62≦RSRP&lt;−60 dBm and 47 of y can indicate from RSRP_LEV_81 to RSRP_LEV_97, namely −60 dBm≦RSRP. These definitions may, for example, be informed by 3GPP TS 36.133, which is hereby incorporated herein by reference in its entirety. 
         [0055]    The measurement can also be defined with respect to EUtranGenericCell. The measurement can be performed at a particular object level, as defined in the NRM Network Resource Model. This particular measurement definition example specifies measurement to be performed at the cell, LTE Cell==EUtranGenericCell object, level. 
         [0056]    The measurement report can be defined to be valid for packet switched traffic. Furthermore, the measurement report can be defined with respect to the evolved packet system (EPS). 
         [0057]    In a third embodiment, there may be explicit triggering of UE measurements without MDT job creation at the NE.  FIG. 3  illustrates a performance measurement interface being used to trigger the UE measurements and to collect performance measurements converted from UE measurements data, according to additional embodiments. 
         [0058]    As shown in  FIG. 3 , at  1 , the NM/IRPManager  110  can create a measurement job via a performance measurement interface, indicating minimization of drive test data is not to be collected or that something other than minimization of drive test data is to be collected. This may be done, for example, by tagging “.Non-MDT” in the measurement name. 
         [0059]    At  2 , EM/IRPAgent  120  can send the measurements job to at least one NE  130 . Then, at  3 , NE  130  may explicitly trigger the periodic UE measurements collection to all connected UEs in the collection period, but not the MDT job. However, the NE  130  may receive the measurements reports from UEs that were configured/triggered for other, non-MDT purposes, for example, mobility robustness optimization (MRO), handover (HO), or the like. 
         [0060]    At  4 , the NE  130  can convert the periodic UE measurements received from the UEs into PM and exclude the event based UE measurements. Then, at  5 , the NE  130  can send the raw periodic measurements from UEs, or can send the performance measurements based on the raw measurements to EM/IRPAgent  120 . 
         [0061]    Finally, at  6 , the EM/IRPAgent  120  can send the performance measurements to NM/IRPManager  110 . Thus, in certain cases, the EM/IRPAgent  120  can convert the raw measurements from the UEs into PMs, as at  4   a   1  in  FIG. 1 . 
         [0062]    Certain embodiments may have various benefits or advantages. For example, certain embodiments may be able to reuse performance measurement interface over Itf-N, without need to increase complexity of trace IRP. Thus, certain embodiments may avoid any problems related to trace IRP re-use. Furthermore, certain embodiments may avoid any need to report the minimization of drive test data, which may have privacy issues, to TCE anymore. Thus, privacy issues with minimization of drive test data can be resolved. Additionally, the periodic measurements can be analyzed separately from event based measurements, thus the result may be more reliable. 
         [0063]      FIG. 4  illustrates a method according to certain embodiments. As shown in  FIG. 4 , the method can include, at  410 , sending performance measurement job activation via a performance measurement interface from a manager indicating that minimization of drive test data is to be collected. The method can also include, at  415 , receiving performance measurements in response to the activation. 
         [0064]    The method can further include, at  420 , receiving performance measurement job activation via a PM interface from a manager indicating that an agent is to collect minimization of drive test data. 
         [0065]    The method can also include, at  422 , performing performance measurement collection with respect to a network element. For example, the measurement collection can be a collection of measurements of UEs associated with the network element. This can be performed by communicating with the network element, rather than by communicating directly with the UEs. The network element can be an access point, such as a base station or eNode B (eNB). Thus, for example, the performing performance measurement collection can include, at  423 , sending an area-based minimization of drive test activation to the network element. 
         [0066]    Moreover, the method can further include, at  424 , receiving performance measurements or measurement reports from the network element. The measurement reports may be raw measurement data. When receiving measurement reports from the network element, the method can also include, at  425 , converting the measurement reports into the performance measurements. 
         [0067]    Additionally, the method can also include, at  426 , providing the performance measurements to the manager. These may be the performance measurements received from the NE or performance measurements calculated or otherwise converted based on raw measurements provided by the NE. 
         [0068]    The method may also include, at  430 , receiving a request for performance measurements from an agent. This request may take various forms, such as an area-based MDT activation. Other forms are also possible. 
         [0069]    In response to this request, the NE optionally may specifically trigger measurement reports from the UEs. For example, the NE can send, at  431 , a measurement configuration selected from a periodic measurement collection to at least one user equipment of the plurality of user equipment. The measurement configuration can be sent to all user equipment connected to a network element performing the method. 
         [0070]    Moreover, the NE can receive, at  432 , measurement reports of minimization of drive test data corresponding to a plurality of user equipment. 
         [0071]    Then, at  434 , the NE can convert user equipment measurement reports to performance measurements. This converting can be performed conditionally upon determining, at  433 , that a network element is configured to convert the measurement reports. If the converting is not needed, it may be omitted. At  436 , the NE can transmit the performance measurements or raw measurement data to the agent. 
         [0072]      FIG. 5  illustrates another method according to certain embodiments. The method of  FIG. 5  may be largely similar to the method of  FIG. 4 , but there may be no explicit indication that MDT is desired, or specifically there may be an indication that MDT data is not desired. Thus, at  510 , a PM job via a performance measurement interface may be sent indicating that non-MDT data is to be collected. 
         [0073]      FIG. 6  illustrates a system according to certain embodiments of the invention. In one embodiment, a system may include several devices, such as, for example, NM/IRPManager  610 , EM/IRPAgent  620 , network element  630 , and user equipment  640 . The system may include more than one EM/IRPAgent  620  and more than one NM/IRPManager  610 , although only one of each is shown for the purposes of illustration. Each of these devices may include at least one processor, respectively indicated as  614 ,  624 ,  634 , and  644 . At least one memory may be provided in each device, and indicated as  615 ,  625 ,  635 , and  645 , respectively. The memory may include computer program instructions or computer code contained therein. One or more transceiver  616 ,  626 ,  636 , and  646  may be provided, and each device may also include an antenna, respectively illustrated as  617 ,  627 ,  637 , and  647 . Although only one antenna each is shown, many antennas and multiple antenna elements may be provided to each of the devices. Other configurations of these devices, for example, may be provided. For example, NM/IRPManager  610 , EM/IRPAgent  620 , network element  630 , and user equipment  640  may be additionally or solely configured for wired communication. In such a case antennas  617 ,  627 ,  637 , and  647  may illustrate any form of communication hardware, without being limited to merely an antenna. For example, antennas  617 ,  627 ,  637 , and  647  may illustrate any form of wired communication hardware, such as a network interface card. 
         [0074]    Transceivers  616 ,  626 ,  636 , and  646  may each, independently, be a transmitter, a receiver, or both a transmitter and a receiver, or a unit or device that may be configured both for transmission and reception. 
         [0075]    Processors  614 ,  624 ,  634 , and  644  may be embodied by any computational or data processing device, such as a central processing unit (CPU), application specific integrated circuit (ASIC), or comparable device. The processors may be implemented as a single controller, or a plurality of controllers or processors. 
         [0076]    Memories  615 ,  625 ,  635 , and  645  may independently be any suitable storage device, such as a non-transitory computer-readable medium. A hard disk drive (HDD), random access memory (RAM), flash memory, or other suitable memory may be used. The memories may be combined on a single integrated circuit as the processor, or may be separate therefrom. Furthermore, the computer program instructions may be stored in the memory and which may be processed by the processors can be any suitable form of computer program code, for example, a compiled or interpreted computer program written in any suitable programming language. 
         [0077]    The memory and the computer program instructions may be configured, with the processor for the particular device, to cause a hardware apparatus such as NM/IRPManager  610 , EM/IRPAgent  620 , network element  630 , and user equipment  640 , to perform any of the processes described above (see, for example,  FIGS. 1-5 ). Therefore, in certain embodiments, a non-transitory computer-readable medium may be encoded with computer instructions that, when executed in hardware, may perform a process such as one of the processes described herein. Alternatively, certain embodiments of the invention may be performed entirely in hardware. 
         [0078]    Furthermore, although  FIG. 6  illustrates a system including NM/IRPManager  610 , EM/IRPAgent  620 , network element  630 , and user equipment  640 , embodiments of the invention may be applicable to other configurations, and configurations involving additional elements, as illustrated and discussed herein (see, for example,  FIGS. 1-5 ). 
         [0079]    Various embodiments are possible. For example, as mentioned above, according to certain embodiments, a method may include sending performance measurement job activation indicating that minimization of drive test data is to be collected (in an alternative, the job can be configured to indicate that non-MDT data is to be collected). The method may also include receiving performance measurements in response to the job activation. 
         [0080]    In certain embodiments, a method may include receiving performance measurement job activation via a performance measurement interface from a manager indicating that an agent is to collect minimization of drive test data. The method may also include performing performance measurement collection with respect to a network element. The method may further include receiving performance measurements or measurement reports from the network element. The method may additionally include providing the performance measurements to the manager. 
         [0081]    In a variation, the method may also include, when receiving measurement reports from the network element, converting the measurement reports into the performance measurements. 
         [0082]    In a variation, performing performance measurement collection can include sending an area-based minimization of drive test activation to the network element. 
         [0083]    A method, according to certain embodiments, may include receiving a request for performance measurements from an agent. The method may also include receiving measurement reports of minimization of drive test data corresponding to a plurality of user equipment. The method may further include converting user equipment measurement reports to performance measurements. The method may additionally include transmitting the performance measurements to the agent. 
         [0084]    In a variation, the converting can be performed conditionally upon determining that a network element is configured to convert the measurement reports. 
         [0085]    In a variation, the method may further include sending a measurement configuration selected from a periodic measurement collection to at least one user equipment of the plurality of user equipment. 
         [0086]    In a variation, the measurement configuration can be sent to all user equipment connected to a network element performing the method. 
         [0087]    In a variation, the method may further comprise excluding event based triggered measurements received from the UEs. For example, only periodically triggered measurement reports from the UEs may be included, in certain embodiments. 
         [0088]    An apparatus, in certain embodiments, may include at least one processor and at least one memory including computer program code. The at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to send performance measurement job activation indicating that minimization of drive test data is to be collected (in an alternative, the job can be configured to indicate that non-MDT data is to be collected). The at least one memory and the computer program code can also be configured to, with the at least one processor, cause the apparatus at least to receive performance measurements in response to the job activation. 
         [0089]    According to certain embodiments, an apparatus can include at least one processor and at least one memory including computer program code. The at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to receive performance measurement job activation via a PM interface from a manager indicating that an agent is to collect minimization of drive test data. The at least one memory and the computer program code can also be configured to, with the at least one processor, cause the apparatus at least to perform performance measurement collection with respect to a network element. The at least one memory and the computer program code can further be configured to, with the at least one processor, cause the apparatus at least to receive performance measurements or measurement reports from the network element. The at least one memory and the computer program code can additionally be configured to, with the at least one processor, cause the apparatus at least to provide the performance measurements to the manager. 
         [0090]    In a variation, the at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to, when receiving measurement reports from the network element, convert the measurement reports into the performance measurements. 
         [0091]    In a variation, the at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to perform the performance measurement collection by sending an area-based minimization of drive test activation to the network element. 
         [0092]    In certain embodiments, an apparatus can include at least one processor and at least one memory including computer program code. The at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to receive a request for performance measurements from an agent. The at least one memory and the computer program code can also be configured to, with the at least one processor, cause the apparatus at least to receive measurement reports of minimization of drive test data corresponding to a plurality of user equipment. The at least one memory and the computer program code can further be configured to, with the at least one processor, cause the apparatus at least to convert user equipment measurement reports to performance measurements. The at least one memory and the computer program code can additionally be configured to, with the at least one processor, cause the apparatus at least to transmit the performance measurements to the agent. 
         [0093]    In a variation, the at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to convert conditionally upon determining that a network element is configured to convert the measurement reports. 
         [0094]    In a variation, the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to send a measurement configuration selected from a periodic measurement collection to at least one user equipment of the plurality of user equipment. 
         [0095]    In a variation, the at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to send the measurement configuration to all user equipment connected to the apparatus. 
         [0096]    In a variation, the at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to exclude event based triggered measurements received from the UEs. 
         [0097]    An apparatus, according to certain embodiments, may include means for sending performance measurement job activation indicating that minimization of drive test data is to be collected (in an alternative, the job can be configured to indicate that non-MDT data is to be collected). The apparatus may also include means for receiving performance measurements in response to the job activation. 
         [0098]    An apparatus, in certain embodiments, can include means for receiving performance measurement job activation via a PM interface from a manager indicating that an agent is to collect minimization of drive test data. The apparatus can also include means for performing performance measurement collection with respect to a network element. The apparatus can also include means for receiving performance measurements or measurement reports from the network element. The apparatus can further include means for providing the performance measurements to the manager. 
         [0099]    In a variation, the apparatus may also include means for, when receiving measurement reports from the network element, converting the measurement reports into the performance measurements. 
         [0100]    In a variation, the performing performance measurement collection comprises sending an area-based minimization of drive test activation to the network element. 
         [0101]    According to certain embodiments, an apparatus may include means for receiving a request for performance measurements from an agent. The apparatus may also include means for receiving measurement reports of minimization of drive test data corresponding to a plurality of user equipment. The apparatus may further include means for converting user equipment measurement reports to performance measurements. The apparatus may additionally include means for transmitting the performance measurements to the agent. 
         [0102]    In a variation, the converting can be performed conditionally upon determining that a network element is configured to convert the measurement reports. 
         [0103]    In a variation, the apparatus can further include means for sending a measurement configuration selected from a periodic measurement collection to at least one user equipment of the plurality of user equipment. 
         [0104]    In a variation, the measurement configuration can be sent to all user equipment connected to the apparatus. 
         [0105]    In a variation, the apparatus may further comprise means for excluding event based triggered measurements received from the UEs. 
         [0106]    In certain embodiments, a computer-readable medium (for example, a signal or a non-transitory computer readable medium) can be encoded with instructions that, when executed in hardware, perform a process. The process can include sending performance measurement job activation indicating that minimization of drive test data is to be collected (in an alternative, the job can be configured to indicate that non-MDT data is to be collected). The process can also include receiving performance measurements in response to the job activation. 
         [0107]    A computer-readable medium (for example, a signal or a non-transitory computer readable medium), according to certain embodiments, can be encoded with instructions that, when executed in hardware, perform a process. The process can include receiving performance measurement job activation via a PM interface from a manager indicating that an agent is to collect minimization of drive test data. The process can also include performing performance measurement collection with respect to a network element. The process can further include receiving performance measurements or measurement reports from the network element. The process can additionally include providing the performance measurements to the manager. 
         [0108]    In a variation, the process may further include, when receiving measurement reports from the network element, converting the measurement reports into the performance measurements. 
         [0109]    In a variation, the performing performance measurement collection may include sending an area-based minimization of drive test activation to the network element. 
         [0110]    A computer-readable medium (for example, a signal or a non-transitory computer readable medium), in certain embodiments, may be encoded with instructions that, when executed in hardware, perform a process. The process can include receiving a request for performance measurements from an agent. The process can also include receiving measurement reports of minimization of drive test data corresponding to a plurality of user equipment. The process can further include converting user equipment measurement reports to performance measurements. The process can additionally include transmitting the performance measurements to the agent. 
         [0111]    In a variation, the converting can be performed conditionally upon determining that a network element is configured to convert the measurement reports. 
         [0112]    In a variation, the process can further include sending a measurement configuration selected from a periodic measurement collection to at least one user equipment of the plurality of user equipment. 
         [0113]    In a variation, the measurement configuration can be sent to all user equipment connected to a network element performing the process. 
         [0114]    In a variation, the process may further comprise excluding event based triggered measurements received from the UEs. 
         [0115]    The embodiments described above can be combined with one another in a system or combined method. The above variations can be used with one another, as desired. 
         [0116]    One having ordinary skill in the art will readily understand that the invention as discussed above may be practiced with steps in a different order, and/or with hardware elements in configurations which are different than those which are disclosed. Therefore, although the invention has been described based upon these preferred embodiments, it would be apparent to those of skill in the art that certain modifications, variations, and alternative constructions would be apparent, while remaining within the spirit and scope of the invention. 
       GLOSSARY 
       [0117]    3GPP Third Generation Partnership Project 
         [0118]    CCO Coverage and Capacity Optimization 
         [0119]    DM Domain Manager 
         [0120]    EDGE Enhanced Data rates for GSM Evolution 
         [0121]    EM Element Manager 
         [0122]    eNB evolved Node B 
         [0123]    EPS Evolved Packet System 
         [0124]    E-UTRAN Evolved UTRAN 
         [0125]    GERAN GSM EDGE Radio Access Network 
         [0126]    GSM Global System for Mobile Communication 
         [0127]    HO Handover 
         [0128]    IE Information Element 
         [0129]    IRP Integration Reference Point 
         [0130]    LTE Long Time Evolution 
         [0131]    MDT Minimization of Drive Tests 
         [0132]    MME Mobility Management Entity 
         [0133]    MRO Mobility Robustness Optimization 
         [0134]    NE Network Elements 
         [0135]    NM Network Manager 
         [0136]    PM Performance Management 
         [0137]    RSRP Reference Signal Received Power 
         [0138]    RSRQ Reference Signal Received Quality 
         [0139]    SON Self-Organizing Networks 
         [0140]    TCE Task Control Element 
         [0141]    TR Technical Report 
         [0142]    UTRAN Universal Terrestrial Radio Access Network 
         [0143]    UE User Equipment