The methods used by the process are the same throughout, the primary variations being the combination of the methods and the quality of data possible at each stage of build, the available data improving in quality as the system build progresses. Where possible, certain aspects of the design can be accepted through this process prior to the formal system acceptance tests conducted prior to the system entering service. The drawbacks of current quantitative and qualitative methods will be highlighted, particularly in relation to the limitations in effectiveness of methodologies currently used for timely advice to the processes of system design. The translating of processes and findings into the recipient s language will be discussed with a specific focus on turning results into practical recommendations. The means of assessing the validity of findings will be presented, particularly in relation to assessment failures and their implications.
Most evaluation methods are applicable to the work of individuals rather than teams.
We will consider the impact of operator roles, teams, and distributed teams on the validity of findings. Project Management issues associated with multi-disciplinary team operations. Scenario generation suitable for prototyping and complex system assessment including development of Measures of Effectiveness and Measures of Performance. Techniques will encompass, but will not be limited to, task analysis, usability, workload and situation awareness methodologies. Evaluation procedures, including briefing and ethical considerations when using human participants.