# A Framework for the Evaluation of the Cultural Heritage Information Ontology
## 3 Evaluation Framework for the Cultural Heritage Information Ontology
#### New Ontology Metrics for Interoperability
\begin{table}
\begin{tabular}{l l c c} \hline \hline \multicolumn{1}{c}{**Characteristics/Sub-Characteristics**} & \multicolumn{1}{c}{**Metrics**} & \multicolumn{1}{c}{**Calculated Value**} & \multicolumn{1}{c}{**Score**} \\ \hline
1. Structural & & & 3.5 \\ \hline Formal relations support & _RROnto_ & 0.25 & 2 \\ Cohesion & _LCOMOnto_ & 6.86 & 2 \\ Tangledness & _TMOnto2_ & 2 & 5 \\ Redundancy & _ANOnto_ & 7.53 & 5 \\ \hline
2. Functional adequacy & & & 2.92 \\ \hline Controlled vocabulary & _ANOnto_ & 7.53 & 5 \\ Schema and value & _RROnto_ & 0.25 & 2 \\ reconciliation & _AROnto_ & 0 & 1 \\  & _ANOnto_ & 7.53 & 5 \\ Consistent search and query & _RROnto_ & 0.25 & 2 \\  & _AROnto_ & 0 & 1 \\  & _INROrtho_ & 1.15 & 5 \\ Knowledge acquisition & _ANOnto_ & 7.53 & 5 \\  & _RROnto_ & 0.25 & 2 \\  & _NOMOnto_ & 3.38 & 4 \\ Similarity & _RROnto_ & 0.25 & 2 \\  & _AROnto_ & 0 & 1 \\ Indexing and linking & _RROnto_ & 0.25 & 2 \\  & _INROrtho_ & 1.15 & 5 \\ Results representation & _AROnto_ & 0 & 1 \\  & _CROnto_ & 0 & 1 \\ Guidance and decision trees & _INROrtho_ & 1.15 & 5 \\  & _AROnto_ & 0 & 1 \\ Knowledge use & _ANOnto_ & 7.53 & 5 \\  & _AROnto_ & 0 & 1 \\  & _INROrtho_ & 1.15 & 5 \\  & _NOMOnto_ & 3.38 & 4 \\  & _LCOMOnto_ & 6.86 & 2 \\ \hline
3. Transferability & & & 3.5 \\ \hline Adaptability & _WMCOnto2_ & 2.32 & 1 \\  & _DITOnto_ & 10 & 1 \\  & _RFCOnto_ & 4.54 & 4 \\  & _CBOnto_ & 1.25 & 5 \\ \hline \hline \end{tabular}
\end{table} 
Table 5: Evaluation results for the CIDOC CRM obtained from the corrected OQuaRE framework. Quality characteristics are the quality of ontology structure, functional adequacy, transferability, reliability, compatibility, maintainability, and operability. Sub-characteristics for the characteristics' maintainability are modularity, reusability, analyzability, changeability,  
\begin{table}
\begin{tabular}{l l l l} \hline \multicolumn{1}{c}{**Characteristics/Sub-Characteristics**} & \multicolumn{1}{c}{**Metrics**} & \multicolumn{1}{c}{**Calculated Value**} & \multicolumn{1}{c}{**Score**} \\ \hline
4. Reliability & & & 2.6 \\ \hline Recoverability & \begin{tabular}{c} _WMCOnto2_ \\ _DITOnto_ \\ _NOMOInfo_ \\ _NOMOInfo_ \\ _NOMOInfo_ \\ _NOMOInfo_ \\ _NOMOInfo_ \\ _NOMOInfo_ \\ \end{tabular}  & \ \begin{tabular}{c} 2.32 \\ 1 \\ 10 \\ 3.38 \\ 6.86 \\ 6.86 \\ 6.86 \\ \end{tabular}  & \begin{tabular}{c} 1 \\ 1 \\ 2 \\ \end{tabular}  \\ \hline
5. Compatibility & & & 3.25 \\ \hline Replaceability & \begin{tabular}{c} _WMCOnto2_ \\ _DITOnto_ \\ _NONOInfo_ \\ _NOMOInfo_ \\ \end{tabular}  & \ \begin{tabular}{c} 2.32 \\ 10 \\ 3.38 \\ 6.86 \\ 6.86 \\ \end{tabular}  & \begin{tabular}{c} 1 \\ 1 \\ 2 \\ \end{tabular}  \\ \hline
6. Interoperability & & & \\ \hline Composability & \begin{tabular}{c} _CPOnto_ \\ Aggregability \\ _AGOnto_ \\ \end{tabular}  & \ \begin{tabular}{c} 0 \\ 0 \\ \end{tabular}  & \begin{tabular}{c} / \\ / \\ \end{tabular}  \\ \hline
7. Maintainability & & & 3.56 \\ \hline Modularity &
\begin{tabular}{c} _WMCOnto2_ \\ _CBOnto_ \\ _WMCOnto2_ \\ _DITOnto_ \\ _NOCOInfo_ \\ _NOCOInfo_ \\ _RFCOnto_ \\ _NOMOInfo_ \\ _CBOutto_ \\ _CBOutto_ \\ _RFCOnto_ \\ _NOMOInfo_ \\ _CBOutto_ \\ _CBOutto_ \\ _CBOutto_ \\ _NOMOInfo_  
modification stability, and testability. An individual sub-characteristic is a combination of different metrics; for example, maintainability is determined by the _WMCOntto2_ (score 1) and the _CBOnto_ (score 5), which, together with other sub-characteristics-metrics, contribute to an average score for maintainability of three. The final evaluation is presented in Table 5 and summarized in Figure 1.  
In comparison with other published OQuaRE evaluations results, such as [27], 11 ontologies for unit measurement were compared, and the lowest total ontology quality average was 2.20. The total quality average of 3.31 (out of 5) for the CIDOC CRM indicates that it could be improved. Recommendations are described in the Discussion and Conclusions section.