# Enhancing Recognition of Human-Object Interaction from Visual Data Using Egocentric Wearable Camera
## 4 Experimental Results and Analysis
### Time and Performance Analysis: ODIR vs. OIIR  
This section provides a comparative analysis of the ODIR and OIIR for HOIR, which highlights significant differences in the performance of these two approaches. The comparison is made in terms of the average F1-score and mean computational time taken for classifying a single instance, which is shown in Figure 7. ODIR, which is a two-stage \begin{table}
\begin{tabular}{l c c c c} \hline
**HOI** & **Acc** & **Pre** & **Rec** & **F1** \\ \hline Bottle: reposition the bottle & 0.65 & 0.8 & 0.65 & 0.7 \\ Bottle: take it out of the drawer & 0.5 & 0.59 & 0.5 & 0.54 \\ Bowl: pick and place & 0.62 & 0.68 & 0.62 & 0.64 \\ Bowl: put the ball in the bowl & 0.89 & 0.89 & 0.89 & 0.87 \\ Bowl: take it out of the drawer & 0.79 & 0.72 & 0.79 & 0.75 \\ Bowl: take the ball out of the bowl & 0.44 & 0.6 & 0.44 & 0.5 \\ Bowl: take it out of the drawer & 0.68 & 0.65 & 0.68 & 0.66 \\ Bowl: take the ball out of the bowl & 0.72 & 0.72 & 0.72 & 0.72 \\ Bucket: pick and place & 0.65 & 0.57 & 0.65 & 0.6 \\ Bucket: pour water into another bucket & 0.74 & 0.59 & 0.74 & 0.66 \\ Chair: pick and place to a new position & 0.5 & 0.46 & 0.5 & 0.48 \\ Chair: pick and place to the original position & 0.45 & 0.49 & 0.45 & 0.47 \\ Kettle: pick and place & 0.88 & 0.75 & 0.88 & 0.81 \\ Kettle: pour water into a mug & 0.85 & 0.78 & 0.85 & 0.81 \\ Knife: cut apple & 0.68 & 0.66 & 0.68 & 0.67 \\ Knife: pick and place & 0.81 & 0.68 & 0.81 & 0.74 \\ Knife: put it in the drawer & 0.41 & 0.54 & 0.41 & 0.46 \\ Knife: take it out of the drawer & 0.58 & 0.68 & 0.58 & 0.61 \\ Lamp: pick and place & 0.64 & 0.72 & 0.64 & 0.67 \\ Lamp: turn and fold & 0.88 & 0.74 & 0.88 & 0.8 \\ Lamp: turn on and turn off & 0.7 & 0.83 & 0.7 & 0.75 \\ Laptop: open and close the display & 0.8 & 0.67 & 0.8 & 0.73 \\ Laptop: pick and place & 0.84 & 0.78 & 0.84 & 0.81 \\ Mug: fill with water by a kettle & 0.64 & 0.65 & 0.64 & 0.64 \\ Mug: pick and place & 0.65 & 0.61 & 0.65 & 0.62 \\ Mug: pick and place (with water) & 0.67 & 0.59 & 0.67 & 0.62 \\ Mug: pour water into another mug & 0.6 & 0.63 & 0.6 & 0.59 \\ Mug: put it in the drawer & 0.36 & 0.43 & 0.36 & 0.38 \\ Mug: take it out of the drawer & 0.64 & 0.56 & 0.64 & 0.59 \\ Pliers: clamp something & 0.75 & 0.72 & 0.75 & 0.73 \\ Pliers: pick and place & 0.49 & 0.58 & 0.49 & 0.52 \\ Pliers: put it in the drawer & 0.38 & 0.46 & 0.38 & 0.41 \\ Pliers: take it out of the drawer & 0.49 & 0.59 & 0.49 & 0.53 \\ Safe: open and close the door & 0.53 & 0.49 & 0.53 & 0.5 \\ Safe: put something in it & 0.53 & 0.56 & 0.53 & 0.54 \\ Safe: take something out of it & 0.45 & 0.63 & 0.45 & 0.51 \\ Scissors: cut something & 0.84 & 0.77 & 0.84 & 0.41 \\ Scissors: pick and place & 0.68 & 0.73 & 0.68 & 0.53 \\ Stapler: bind the paper & 0.67 & 0.58 & 0.67 & 0.5 \\ Stapler: pick and place & 0.69 & 0.73 & 0.69 & 0.54 \\ Storage furniture: open and close the door & 0.44 & 0.75 & 0.44 & 0.52 \\ Storage furniture: open and close the drawer & 0.72 & 0.88 & 0.72 & 0.79 \\ Storage furniture: put the drink in the door & 0.64 & 0.74 & 0.64 & 0.68 \\ Storage furniture: put the drink in the drawer & 0.61 & 0.76 & 0.61 & 0.67 \\ Toy car: pick and place & 0.52 & 0.66 & 0.52 & 0.58 \\ Toy car: push toy car & 0.41 & 0.54 & 0.41 & 0.46 \\ Toy car: put it in the drawer & 0.3 & 0.46 & 0.3 & 0.36 \\ Toy car: take it out of the drawer & 0.5 & 0.49 & 0.5 & 0.48 \\ Trash can: open and close & 0.65 & 0.68 & 0.65 & 0.66 \\ Trash can: throw something in it & 0.59 & 0.57 & 0.59 & 0.58 \\ \hline Average & 0.62 & 0.64 & 0.61 & 0.60 \\ \hline \end{tabular}
\end{table} 
Table 5: _Cont._method, first identified objects and then classified their relevant interactions, and thus, resulted in an inference time of 1.22 milliseconds per sample. However, the overall average F1-score (based on object recognition and interaction classification results) obtained for ODIR was 74%.