Assessment diff logging
Add response id to the diff output; fix a bug with argument justifications and N/A
Add realis to diff
Add new method to show context
Allow expanding an annotation store based on realis assessment.

An annotation store can be expanded in the following way: for each assessed response with
an incorrect realis, make a copy of it with the same assessment, but with the realis in
the original response replaced with the assessed realis. This program does that.
Bugfix: when expanding answer key based on realis, ensure inconsistent assessments are not added
Implement new rules for handling temporal arguments during scoring.

From the e-mail to the TAC mailing list:

 We would like to make the following proposed change to the assessment and scoring of *Time* arguments.

  (1) Systems are required to report CAS for Time arguments in the XXXX-XX-XX timex format (and not the week-based format). Note: This was already true.
   There is pretty good library support for doing so, see for example:
    Java: http://www.joda.org/joda-time/
     Python: https://docs.python.org/2.7/library/datetime.html(standard library)
      Haskell: http://hackage.haskell.org/package/datetime-0.1

       (2) Assessmentwill judge the context of the temporal CAS in the context as specified in the current guidelines.

        (3) LDC will *not* do coreference of temporal arguments

         (4) The scoring metric will 'ignore' times that are subsumed by more specific times for (EventType, Role, CAS, Realis) tuples. That is given correct answerswith:
          R1: (Transport.Movement, Time, 2014-04-XX, Actual)
           R2: (Transport.Movement, Time, 2014-XX-XX, Actual)

            R1 will be 'required' to achieve 100% recall; R2 will be ignored (i.e. not treated as a FA, but also not sufficient to match R1).

             For participants, this will raise the importance of finding a correct, and most specific date (and in cases where the date is given as e.g. the 15th week of 2014, systems will have to do the temporal resolution.)
Allow scoring over multiple system outputs at a time
Pilot evaluate script works through uncompressing participant submissions
Evaluation script works through uncompressing LDC assessments and removing .out extension
Pilot evaluation script works through assessment store repair
Pilot evaluation script works through realis expansion
Quote filter for pilot data
Pilot evaluation script works through quote filtering
Catch and repair illegal TIMEX expressions
Pilot evaluation script works all the way through scoring
Bugfix: need a new copy of the corpus observers for every system output scored
IMPORTANT BUGFIX: False negatives were missed during scoring if they were also false positives
Remove accidentally committed debugging code
Allow turning on/off realis expansion and quote filtering in pilot script