# Mobile Broadband Performance Evaluation: Analysis of National Reports
## 3 Case Studies
### Annual Survey on InfoComm Usage: Singapore  
_Regulator_\(\rightarrow\) Since 1990, the Infocomm Media Development Authority (IMDA) of Singapore has been conducting quality assessments and studies. Although the results were published in the survey [14], technical results are in the accompanying website (QoS Reports accessed on 26 January 2022). Although the report was released in 2019, the evaluation available on the web is of 2020.  
_Operators_\(\rightarrow\) There are three prominent mobile broadband service providers that are included in the report: M1, Singtel, and StarHub  
_Method_\(\rightarrow\) Around 6000 Singaporeans have been surveyed in 2019. The survey is conducted to represent only citizens and permanent residents as well as the number of individuals living in a single household. Data were collected via face-to-face interviews rather than online. In addition, on-field measurements of signals by professionals are also used. Although IMDA mentioned another specification document to be used together with the survey it was not stated which document.  
_Metrics_\(\rightarrow\) The metrics used in the IMDA report are organized as follows:  
* Outdoor/Tunnel coverage \(\rightarrow\) SNR \(>-100\) dBm;
* Call success rate (SR) \(\rightarrow\) connecting to calling or getting a busy tone;
* Call drop rate (DR) \(\rightarrow\) unintended disconnection during \(>\)100 s call;
* Indoor coverage \(\rightarrow\) \(>85\%\) coverage per building.  
* Outdoor/Tunnel coverage \(\rightarrow\) SNR\(>-109\) dBm;
* Indoor coverage \(\rightarrow<85\%\) coverage per building.  
_Evaluated services_\(\rightarrow\) In Singapore, 3G is used for voice and SMS, whereas 4G is for data services as this is a small nation the report does not refine the data based on rural and urban areas.  
_Result_\(\rightarrow\)
* According to the IMDA's 3G Public Cellular Mobile Telephone Service (PCMTS) QoS framework, MNOs' outdoor coverage should be \(>\)99%. That is, the SNR received from an MNO by stations in any outdoor area in Singapore should be \(>\)\(-\)100 dBm. As of 2019, all three MNOs provide \(>\)99% voice service coverage. For tunnels, only a pass or fail is given based on the services provided and all three MNOs passed in all tunnels.
* Similarly, a 99% call success rate is expected using the PCMTS framework, which all three MNOs fulfilled.
* The call drop rate should be \(<\)1% under the PCMTS framework, which none of the MNOs are above.
* Sixty buildings were selected to test the indoor services. Even though the data from the fourth quarter of 2019 are not completed yet, all three MNOs have an average score of 59/60. This means there is 99% indoor voice service coverage.
* As for 4G service, all three prominent MNOs and one new operator (TPG) are evaluated. The 4G service QoS framework was lowered for TPG since it is new. However, all four MNOs provide \(>\)99% outdoor service, have a pass mark in all tunnels, and have an average score of 58/60 in indoor coverage.  
Policies_\(\rightarrow\) IMDA sets a QoS standard and updates it regularly. An update is issued when there is industrial, technological, or consumer demand change. MNOs are expected to fulfill the QoS requirement or receive a USD 50,000 fine.  
The results from the IMDA report are few as Singapore is a small nation. In addition, all MNOs including the new one provide excellent mobile broadband service as there are few areas to cover.