The variables and potential values of variables are specified in advance. All actions of the user of an application are recorded. Transaction logs can be read through by the analyst to understand how the application is used. Different types of protocol analyses can be conducted to find patterns in the transaction logs. Transaction logs will be examined on an individual session basis.
Transaction logs contain much more local detail about usage than the statistical summaries.
Both methods will be supplemented with other social scientific methods such as observations, user surveys, etc. Transaction logs have been instrumented into the prototype full text search being developed by Bill Mischo. The transaction logs will be collected only during specified test periods and the statistical summaries will be generated on an ongoing basis. User name, name, contact information and participant ID will be securely stored in one place. Users sometimes dislike new passwords for each system.