Techniques for evaluating awareness mechanisms must be based on what is being evaluated. In order to evaluate the mechanism all three of these pieces must be evaluated. Validity of evaluation techniques. Time aspect of evaluation. Longitudinal studies are often necessary, but expensive.
People are very adaptable Test instruments.
A body of test instruments which can be used in various situations and with a variety of groups is needed to facilitate cross study comparisons. Evaluation in isolation. Awareness is a social construct and so, tools to support it cannot be studied in isolation. Studies must look at groups, and also look at how the tools fit with other tools individuals and groups are using. The final outcome of this group was a delineation of what we can measure and how we can measure it.