# Measuring Quality of Service in a Robotized Comprehensive Geriatric Assessment Scenario
## 5 Experimental Evaluation
### Experiments in Real Scenarios  
In the consortium of the CLARC project, there are two research groups that are very close to end-users. One of them is a research group of the Hospital Virgen del Rocio of Seville (Spain), and the other one is from the University of Troyes (France), which has strong links with the Hospital of Reims \begin{table}
\begin{tabular}{c c c} \hline \hline
**Time (s)** & **Observations** & **Contexts** \\ \hline
10 & O2:O8 & PersonDetected \\ \hline
120 & O5:O9 & CallingDoctor \\ \hline
140 & O12:O3 & RESTARTED \\ \hline
170 & O1:O7 & PersonIsNextToChair \\ \hline
225 & O1:O7 & PersonIsSeated \\ \hline
235 & O1:O8 & PersonGetSUp \\ \hline
250 & O1:O7 & PersonIsSeated \\ \hline
270 & O1:O2 & Scored,FINISHED \\ \hline \hline \end{tabular}
\end{table} 
Table 7: Get Up & Go #9: (Left) Contexts and observations generated by the system. (Right) Graphical evolution of the properties values during the test. (France). Thus, from January 2019 to March 2019, a CLARC robot (in its final version) was deployed at the Hospital of Reims (see Figure 8 (left)) and two others (first versions of CLARC) at the Hospital Virgen del Rocio (see Figure 8 (right)). The one at Reims worked in the geriatric unit, but those in Seville were tested in several care centres. Several complete test executions were recorded in both scenarios and deeply analyzed. The experimental evaluation on this Section is built using 22 Barthel tests and 13 Get Up & Go tests. Table 8 details the Barthel tests performed with real patients. Each column provides the patient's response to each question on the test. As in the previous Section, we detail how patients answered each question: if they used the remote control (RC), the touch screen (TS) or the voice interface (VR), and if they answered in the first (1 st) or second (2 nd) attempt (or did not answer (QNA)). We can also know if they pressed the pause/restart buttons (PR) or the calling doctor/restart buttons (CDR), or if they were undetected for a while (NPD). We are grouped in the same row of the table the patients that completed the test exhibiting the same behaviour. For instance, patients #3, #5, #7, #17, and #22 completed the tests in the same way: answering all the questions in the first attempt (1 st) using the touch screen (TS). From the point-of-view of our system, the evolution of the QoS metrics for the group of users in each one of the rows of the table is practically identical, regardless of the small differences in the response time of the patients. \begin{table}
\begin{tabular}{c c c c c c c c c c c} \hline \hline
**Group** & **Patient \#** & **Q1** & **Q2** & **Q3** & **Q4** & **Q5** & **Q6** & **Q7** & **Q8** & **Q9** & **Q10** \\ \hline
1 & 1 st,VR & 1 st,VR & 1 st,VR & QNA & 1 st,VR & 1 st,VR & 1 st,VR & 1 st,VR & 1 st,VR & 1 st,VR \\ \hline
2 & 2,14 & 2 nd,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS \\ \hline
3 & 3,57,17,22 & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS \\ \hline
4 & 4 & QNA & 1 st,VR & QNA & 1 st,VR & QNA & QNA & 1 st,VR & QNA & QNA & QNA \\ \hline
5 & 6 & 1 st,TS & 1 st,TS & 1 st,TS & QNA & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS \\ \hline
6 & 8 & 1 st,TS & QNA & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS & 1 st,TS \\ \hline
7 & 9,10,12,13,16,18,20 & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC \\ \hline
8 & 11 & PR,2 nd,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC \\ \hline
9 & 15 & 2 nd,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC & 1 st,RC \\ \hline
10 & 19 & 1 st,VR & 1 st,VR & 1 st,VR & 1 st,VR & 1 st,VR & 1 st,VR & 1 st,VR & 1 st,VR & 1 st,VR & 1 st,VR \\ \hline
11 & 21 & PR,2 nd,RC & 1 st,RC & 2 nd,RC & 1 st,RC & 2 nd,RC & 2 nd,RC & NPD,1 st,RC & 1 st,RC & NPD,2 nd,RC & 1 st,RC \\ \hline \hline \end{tabular}
\end{table} 
Table 8: Barthel tests performed in real scenarios.