## 3 Materials and Methods
### Procedure
#### 3.3.2 Study 2: Cognitive Walkthrough  
Cognitive walkthrough [42] is a type of inspection method that is developed to evaluate the ease of learning of a user interface. The process of cognitive walkthrough consists of five steps: prerequisite is to identify the user characteristics, context, tasks, and description mock-up or prototype. Then, during the session, the experts and designer sit together to analyze; they need to answer three questions. In the end, the recorded information is compiled. Finally, identified problems are required to be fixed [8]. This method is focused on identifying specific users' problems in using the provided interface. The study was conducted to validate and evaluate the ERP system from the users' perspective, leading them to the correct action to achieve their goals. Table 4 shows a list of the tasks developed for this study:  
Procedure  
Four usability and ERP system experts participated in the cognitive walkthrough study. We selected one ERP system to evaluate in this study. The experts were provided with the four tasks presented in Table 4. The experts performed each task guided by the three following questions:  
Q1: Will the correct action(s) be evident to the users? (The actions they know to achieve the task.) Q2: Will the users find the proper control to be used for their next action, and it appears when needed? \begin{table}
\begin{tabular}{c c} \hline \hline
**Tasks** & **List of Tasks for the Cognitive Walkthrough Study** \\ \hline
**Task 1** & Check the monthly salary sheets for last month. \\ \hline
**Task 2** & Change the payroll of [PERSON] to 8000. \\ \hline
**Task 3** & Add leave balances for employee [PERSON], which starts on 2 December 2019 until 9 December 2019. \\ \hline
**Task 4** & Add new allowance for employee [PERSON] with amount 900. \\ \hline \hline \end{tabular}
\end{table} 
Table 4: Tasks designed for cognitive walkthrough study. \begin{table}
\begin{tabular}{c c c} \hline \hline
**S.N** & **The Found Usability Problems** & **Usability Problem under the Topics in Table 1** \\ \hline
1 & The interface is a mixture of two languages (Arabic and English). & 6 (Contextual data and **information organization issues**) \\ \hline
2 & The help option functionality is lacking help. & 6 (**Contextual data** and information organization issues) \\ \hline
3 & There is no help and system-related documentation available. & 6 (**Contextual data** and information organization issues) \\ \hline
4 & Many actions have no clear feedback. & \(1\) (**Lack of feedback** and complex interface) \\ \hline
5 & There is more than one refresh button on the same page. & 2 (Unstructured data and **information overload**) \\ \hline
6 & The number of dialogues related to various functions is limited. & 2 (**Unstructured data** and **information overload**) \\ \hline
7 & The flow of functions is not clear. & 3 (**Difficulty in searching and finding desired item/information in interface** and **error handling**) \\ \hline
8 & The system does not show any alert if something crucial happens. & 3 (Difficulty in searching and finding desired item/information in interface and **error handling**) \\ \hline \hline \end{tabular}
\end{table} 
Table 3: The usability problems reported by participants in the heuristic evaluation of ERP systems. Q3: Will the user receive sensible feedback that tells if they have made a correct or incorrect choice of action? Results  
The concepts associated with the usability problems checklist are shown in bold words in the last column. Table 5 reports the usability problems found during the cognitive walkthrough evaluation of the ERP system. The different usability problems found in the ERP system are related to the topics listed in Table 1. The concepts that map the problems with the usability problems checklist are shown in bold words in the last column. In particular, the study shows that availing too many user options on the ERP user interface causes about 30% of the total ERP usability problems.