Evaluating document filtering systems over time
We propose a new way of measuring document filtering system performance over time. Performance is calculated per batch and a trend line is fitted to the results. Systems are compared by their performance at the end of the evaluation period. Important insights emerge by re-evaluating TREC KBA CCR runs of 2012 and 2013.
evaluation time-aware information retrieval significance testing