# An Information Theoretic Approach to Privacy-Preserving Interpretable and Transferable Learning
## 5 Information Theoretic Measures for Privacy Leakage, Interpretability, and Transferability
### A Unified Approach to Privacy-Preserving Interpretable and Transferable Learning

Table 11: Accuracy (in %, averaged over 20 experiments) obtained in _dslr\(\rightarrow\)uchelm_ semi-supervised transfer learning experiments. The first and second best performances have been marked. \begin{table}
\begin{tabular}{c c c} \hline \hline
**Method** & **Feature Type** & **Accuracy (\%)** \\ \hline privacy-preserving maximum interpretability-measure model & VGG-FC6 & 88.9 \\ privacy-preserving maximum transferability-measure model & VGG-FC6 & 89.0 \\ non-private ILS (1-NN) & VGG-FC6 & **95.5** \\ non-private CDLS & VGG-FC6 & 90.7 \\ non-private MMDT & VGG-FC6 & 86.1 \\ non-private HFA & VGG-FC6 & 86.9 \\ non-private OBTL & SURF & 83.2 \\ non-private ILS (1-NN) & SURF & 80.1 \\ non-private CDLS & SURF & 68.5 \\ non-private MMDT & SURF & 74.1 \\ non-private HFA & SURF & 60.5 \\ \hline \hline \end{tabular}
\end{table} 
Table 12: Accuracy (in %, averaged over 20 experiments) obtained in _dslr\(\rightarrow\)uchelm_ semi-supervised transfer learning experiments. The first and second best performances have been marked. \begin{table}
\begin{tabular}{c c c} \hline \hline
**Method** & **Feature Type** & **Accuracy (\%)** \\ \hline privacy-preserving maximum interpretability-measure model & VGG-FC6 & \(\underline{92.3}\) \\ privacy-preserving maximum transferability-measure model & VGG-FC6 & \(\underline{88.8}\) \\ non-private CDLS & VGG-FC6 & \(\underline{87.4}\) \\ non-private CMDT & VGG-FC6 & \(\underline{84.7}\) \\ non-private HFA & VGG-FC6 & \(\underline{85.1}\) \\ non-private OBTL & SURF & \(\underline{55.0}\) \\ non-private ILS (1-NN) & SURF & \(\underline{54.3}\) \\ non-private CDLS & SURF & \(\underline{51.8}\) \\ non-private MMDT & SURF & \(\underline{47.7}\) \\ non-private HFA & SURF & \(\underline{56.5}\) \\ \hline \hline \end{tabular}
\end{table} 
Table 13: Accuracy (in %, averaged over 20 experiments) obtained in _webcam\(\rightarrow\)amazon_ semi-supervised transfer learning experiments. The first and second best performances have been marked. \begin{table}
\begin{tabular}{c c c} \hline \hline
**Method** & **Feature Type** & **Accuracy (\%)** \\ \hline privacy-preserving maximum interpretability-measure model & VGG-FC6 & \(\underline{81.4}\) \\ privacy-preserving maximum transferability-measure model & VGG-FC6 & \(\underline{81.4}\) \\ non-private ILS (1-NN) & VGG-FC6 & \(\underline{82.8}\) \\ non-private CDLS & VGG-FC6 & \(\underline{78.2}\) \\ non-private CMDT & VGG-FC6 & \(\underline{78.2}\) \\ non-private MMDT & VGG-FC6 & \(\underline{73.6}\) \\ non-private HFA & VGG-FC6 & \(\underline{74.4}\) \\ non-private OBTL & SURF & \(\underline{37.4}\) \\ non-private ILS (1-NN) & SURF & \(\underline{38.6}\) \\ non-private CDLS & SURF & \(\underline{33.5}\) \\ non-private MMDT & SURF & \(\underline{32.2}\) \\ non-private HFA & SURF & \(\underline{29.0}\) \\ \hline \hline \end{tabular}
\end{table} 
Table 14: Accuracy (in %, averaged over 20 experiments) obtained in _webcam\(\rightarrow\)caltech256_ semi-supervised transfer learning experiments. The first and second best performances have been marked. \begin{table}
\begin{tabular}{c c c} \hline \hline
**Method** & **Feature Type** & **Accuracy (\%)** \\ \hline privacy-preserving maximum interpretability-measure model & VGG-FC6 & \(\underline{92.3}\) \\ privacy-preserving maximum transferability-measure model & VGG-FC6 & \(\underline{88.8}\) \\ non-private CDLS & VGG-FC6 & \(\underline{87.4}\) \\ non-private CMDT & VGG-FC6 & \(\underline{84.7}\) \\ non-private HFA & VGG-FC6 & \(\underline{85.1}\) \\ non-private HFA & VGG-FC6 & \(\underline{85.1}\) \\ non-private HFA & VGG-FC6 & \(\underline{87.3}\) \\ non-private OBTL & SURF & \(\underline{75.0}\) \\ non-private ILS (1-NN) & SURF & \(\underline{70.8}\) \\ non-private CDLS & SURF & \(\underline{60.7}\) \\ non-private MMDT & SURF & \(\underline{67.0}\) \\ non-private HFA & SURF & \(\underline{56.5}\) \\ \hline \hline \end{tabular}
\end{table} 
Table 15: Accuracy (in %, averaged over 20 experiments) obtained in _webcam\(\rightarrow\)dslr_ semi-supervised transfer learning experiments.