## 3 Evaluation
### Case Study 2: Organization B  
Ten respondents answered the Compliance Evaluation Sheet. Four roles are represented in the sample: CIO (10%), Vice-president (10%), Manager (20%), and Group Leader (60%). The second questionnaire was answered just by the CIO of the company. With regards to the first questionnaire, the descriptive statistics are shown in Table 5.  
Overall, it should be noted once again that the means are, in all cases, higher in Phase II than in Phase I, while standard deviations differ. Considering the first variable, it can be seen that it is lower in Phase II. Variable two and variable four are more dispersed too. It can be concluded that there is less  
\begin{table}
\begin{tabular}{c c c} \hline \hline
**Metric** & **Phase I** & **Phase II** \\ \hline Avg. time between identification of external compliance issues and resolution & 48 & 45 \\ \# of compliance issues where employees seek guidance/assistance & 19 & 20 \\ \# of reports of alleged or actual compliance violations & 89 & 60 \\ \% of compliance opportunities implemented & 73 & 79 \\ Yearly compliance reviews & 6 & 6 \\ \hline \hline \end{tabular}
\end{table}
Table 4: Compliance metrics, comparison of phases. Case Study 2.  
\begin{table}
\begin{tabular}{l c c c c} \hline \hline  & \multicolumn{2}{c}{**Phase I**} & \multicolumn{2}{c}{**Phase II**} \\ \cline{2-5}  & **M** & **SD** & **M** & **SD** \\ \hline Satisfaction on cloud services & 4.00 &.667 & 4.40 &.516 \\ Satisfaction on CM in cloud & 3.70 &.823 & 4.20 &.632 \\ CM contribution to IT quality of service & 3.10 &.568 & 3.80 &.632 \\ CM contribution to the organizational CM & 3.10 &.568 & 3.60 &.516 \\ \hline \hline \end{tabular}
\end{table}
Table 5: Descriptive statistics on the compliance evaluation sheet. Case Study 2.  
dispersion in respondents' opinions, thus collecting a higher consensus. Furthermore, the agreement is generated with a higher satisfaction. Anyhow, concerning variable three, there is a higher dispersion in Phase II compared to Phase I. The Student's T test shows a statistical difference in the third aspect of CM's contribution to the IT quality of service, t (9) = \(-2.605\), \(p<0.05\).  
With regards to compliance metrics questionnaire, Table 6 shows the data collection:  
The main aspects in the compliance metrics are as follows:  
1. Concerning the average time span between identification of external compliance issues and resolution, Phase 2 illustrates a minor difference (2.18%) in the resolution of compliance issues after the implementation of the framework. There is once again a limited difference, although, it can be considered as a good sign in favor of the adoption of the framework.  
2. Considering the number of compliance issues where employees require advice or support, Phase 2 demonstrates a decrease (9.10%) in the problem recognized in which employees ask for support. Once again, differences are minimum and oppose the prior justifications. It is because this can be engrained from a more detailed process implemented with the framework  
3. Regarding the number of reports of supposed or actual compliance violations, figures reduced from 76 to 58 (23.78%). Although these facts are very inspiring, we want to highlight that the sample size was reasonably small and the generalization of the results is endangered by the unlikelihood of isolating the external factors from the variables. Anyhow, it is should be considered that the enhancement is aligned with the rest of the metrics provided.  
4. Concerning the percentage of compliance enhancement opportunities implemented, it can be seen that there is again a minimum improvement (4%). This is also a sign of the validity of the framework for the effectiveness and efficiency of the management of compliance problems.  
5. The last part regarding the frequency (in days) of compliance reviews stays stable. In this case again, the organization in Phase 1 offered a compliance management procedure, where reviews were considered to be part of the process. This process stays without any changes in Phase II.