# Motion Generation for Crane Simulators Using Streamlined Motion Blending Technology
## 5 Implementation and Evaluation
### Application Effect Evaluation  
Since motion is a performance that cannot be accurately measured, the effectiveness of the motion simulation system can only be evaluated by the subjective feelings of the system users. After the successful development of this system, it has experienced two stages of performance evaluation:  
The first stage is an open and uncontrolled subjective evaluation. The personnel involved in the evaluation include the personnel of the project research team and the crane driver who voluntarily participate in the evaluation, who have a deep understanding of the system function, and most of them are positive evaluations.  
The second stage is completely controlled subjective evaluation. Several old drivers with rich practical experience but never having used a crane training simulator are invited to participate in the test operation, and then a questionnaire survey is carried out. The design of the questionnaire refers to the literature. Finally, the motion simulation performance of the system is evaluated according to the results of the questionnaire survey.  
A total of seven drivers were invited in the experiment, all of whom were males with an average age of 38, and the average driving age for quay cranes was 16 years. The test steps are as follows: firstly, the driver completes the operation cycle defined in Section 2 on the crane virtual simulation training platform without motion simulation platform. At this time, the driver can only rely on the auxiliary training function provided by the visual system and the analog audio system. Then, for the same work cycle, open the visual system, sound simulation system, and motion simulation system. Finally, let the driver make a subjective evaluation of the training effect; the most important thing in the evaluation is the introduction of motion simulation platform to improve the training effect. The evaluation questionnaire contains five statements, and the scoring benchmark is based on the standardized Likert scale, with 1 point strongly disagreeing; 5 points means strong column consent, equivalent to the score according to the feeling of operation on the real crane.  
Table 3 shows the average score of each statement in the questionnaire collected after the completion of the controlled subjective evaluation test. Figure 16 is the corresponding histogram. To evaluate the training effectiveness of the crane simulator, define a comprehensive training effectiveness index for measurement for the condition in which the comprehensive training effectiveness index is set to 100% when the trainees are trained on the real crane. It can be seen from Table 3 and Figure 16 that, according to the simple comprehensive average estimation, the comprehensive training effectiveness index of the crane simulator can reach 54 % (2.7/5) if the simulator excludes any motion simulation system and only relies on the visual system and the acoustic effect system. As a comparison, once the motion simulation system is added, the comprehensive training effectiveness index can be improved to 82% (4.1/5). Such experimental data show that the subjects also have a certain sense of motion without the motion simulation system and only depending on the visual system and acoustic effect system, but once the motion simulation system is introduced, the subjects' sense of motion has been significantly improved, resulting in a significant improvement in the comprehensive training effect.