## 3 Evaluation Results and Discussion
### Evaluation of Smart System Using Product Quality Model
\begin{table}
\begin{tabular}{p{34.1 pt} p{341.4 pt}} \hline \hline
**Attribute** & **Smart Logistics System Performance Description** \\ \hline \multirow{8}{*}{Functionality} & **Suitability**: The smart system is designed for management of pruning biomass logistics activities. It is suitable for collecting and managing pruning-related data and provides service for all registered actors of the pruning supply chain. \\  & **Completeness**: The system enables complete data to be obtained regarding the biomass quality and quantity as well as its flow along the supply chain. \\  & **Accuracy**: For more than 95\% of data parameters included in the spreadsheet-based database, the system accurately displays the recorded data and information. In some cases, errors were noticed, mainly due to problems encountered during data transfer from the smart box. \\  & **Interoperability**: The smart system effectively integrates different functional units such as GPS and GPRS/GSM devices, temperature and humidity recording tools, and the information platform. The data stored in the central database can be downloaded and easily analyzed using spreadsheets, facilitating further interoperability of the system. \\ \hline \multirow{8}{*}{Efficiency} & **Time saving**: The tool enables transporters to plan their best transport routes, reducing driving time and distance. Each producer can use the online platform to announce its products while end users and/or traders can buy the ready products and transport services easily online, where the system is managed by an administrator. \\  & **Resource utilization**: Once the pruning biomass-to-energy value chain is initiated, the smart system facilities the coordinated utilization of available resources owned by actors in the chain. \\  & **Capacity**: The smart system has functional capacity to record, transfer, and store adequate data along the pruning biomass logistics chain from producer to end user. It facilities the traceability of pruning quality and logistics management, leading to economic efficiency. \\ \hline \multirow{8}{*}{Usability} & **Appropriateness**: The smart system is appropriate, as it enables recording, documentation, and having adequate data centrally, which in turn facilitates the performance analysis and traceability of pruning biomass. \\  & **Learnability**: The tool has a guiding manual to facilitate training and learning to use the system. \\  & Once registered by the administrator, each actor can easily practice and use the information platform. \\  & **User error protection**: Once training is provided, there are fewer user errors when using the smart box. \\  & Once the power cable is plugged in, the recording will be triggered (started and ended) by a separate portable scanner used to read QR codes on biomass labels. While using the information platform, each registered actor can record and edit only the data he/she provides but not those of other users. Therefore, user error is minimized and can be easily corrected by the respective responsible actor. \\  & **Accessibility**: The smart system will be accessible to all interested actors involved in the pruning-to-energy value chain. However, each user should be registered by the system administrator first and get a specific identification code (labelling code as described in [2; 10]). \\  & **Understandability**: The system can be used effectively if initial training and user guide documents are provided. However, how to interpret some displayed values and how to analyze the gathered data can be difficult for many users and should be handled only by experienced (well-trained) system administrators. \\  & **Attractiveness**: The web-based user interface information platform has integrated up-to-date Google Maps, which increases the aesthetics and attractiveness of the online platform. \\  & **Operability**: Components of the smart box are connected to a recording unit by cables [2] (see Figure 5). It has no plug-in and plug-out system for the cables increasing difficulty during operation, indicating that improvement is required. There should also be power on and off buttons for user-friendly operation. \\ \hline \multirow{8}{*}{Reliability} & **Maturity**: The smart system is newly developed and tested for the first time. Further repeated tests and evaluation are recommended to increase its maturity level. \\  & **Availability**: The tool is newly developed and not available on the market. From feedback during testing activities, there is a potential market for the smart system, and the tool could be made available for marketing. \\  & **Fault tolerance**: The test results indicate that all registered pruning products were successfully recorded and stored in the central database with associated product quality characteristics. This indicates that a trader or consumer can confidently order any product registered on the information platform and made ready for sale. Other faults, if any, in relation to real-time data during transport may be tolerable. \\  & **Recoverability**: Once the product is registered in the central platform, much associated information will be generated as the product moves downward along the pruning logistics chain. This increases the recoverability of some missed data, if any. \\ \hline \hline \end{tabular}
\end{table}