## 3 Data Analysis Results and User Feedback
### Practitioners' View on KeepOperational  
Module KeepOperational targeted the experienced shortcomings in the planning and management of a large-scale evacuation. KeepOperational was used by AC police during the trial. However, being a web-based tool, it could easily be applied by additional response teams and support automatic information sharing.  
We assumed that the tool would create the most added value during the impact phase. This assumption could be confirmed for all aspects considered except learning (Figure 7). The usability of KeepOperational was rated predominantly in the positive range. The highly improved effectiveness and efficiency ratings from about 40% consent to 90%-100% are an indicator that operators could gain confidence and experience by using the tool more frequently. Satisfaction also increased comparably from the threat to the impact phase (Figure 7, usability). The assessment results show that KeepOperational was easy to learn and to understand (Figure 7, learning). This fits in with the fact that not much training was required in the preparation to the trial to familiarize the practitioners with the basic features.  
In the individual feedback, it was stated that the results were a solid addition for the AC police and that KeepOperational could be integrated well into the existing workflows. This is in line with the evaluation based on underlying items (Figure A2, utility). Overall CM function support was rated in the affirmative spectrum. The low proportion of neutral answers indicates that some users were still  
Figure 7: Results for the variables usability, learning, utility, and CM function support for module KeepOperational differentiated by scenario phase.  
not fully convinced by its features (Figure 7, CM function support). This can be related to requests to improve the tool in the free-text amendments e.g., through visualization of differences in water depths, just as it was stated for the ZKI module. In KeepOperational, this could already be implemented to a certain extent with the existing technical means. However, KeepOperational only utilizes the flood information provided by other sources and can only comply with this request if sufficient data on the water depth and extent can be made available. One point of criticism has been the technical maturity of KeepOperational (Figure A2, CM Function support). As KeepOperational is a tested prototype, but not a finalized product, this is not unexpected.  
By reviewing all data provided by the TTI, it became clear that some newly introduced features of KeepOperational were not used at all. These were mostly smaller additions to the user interface, intended to ease working with KeepOperational. For example, a highlight and comment feature of the map. Some of these features were requested in the preparation phase of the trial and implemented to be assessed due to that feedback. We assume that the training was lacking sufficient focus on these new features.  
The trial team concluded in its innovation line assessment that KeepOperational could provide additional, objective insights for traffic management in crisis situations. Instead of relying on expert judgements only, KeepOperational supported creating a robust traffic circulation plan at AC police. The overall positive results show that sharing full-coverage crisis information like ZKI's flood extents is not only crucial for creating a situational awareness but can also be vital base information for other applications. By making it easier to utilize this information, KeepOperational creates additional value to ZKI's products within the DLR system by providing a readily accessible traffic application.