Patent ID: 8495488

Claim:
A computer executing a document markup tool for annotating existing authored documents, operable by a user at a user interface of the computer to: recognize the members of a set of existing documents; open one of the existing documents in a set and display its contents to a user together with a toolbar; and, select locations in the document and, using the toolbar, add commentary and scores to the document; wherein the markup tool is automatically operable to: total the scores made in a document; display the scores in a graphical report in the document; display a moderation panel for ensuring marking consistency across multiple markers, wherein the moderation panel: (a) enables graphical and statistical comparisons of the scores made in a subset of marked documents, to the scores added to all the marked documents of the set; (b) allows changes to scores in the subset of marked documents using the displayed moderation panel, and reflects the changes made in the displayed moderation panel by updating the graphical and statistical comparisons; (c) enables graphical and statistical comparisons of the scores made by one marker in the subset of marked documents, to the scores made by one or more other markers in the subset of marked documents or all the marked documents of the set; and (d) allows changes to the scores made by one of the markers in the subset of marked documents using the displayed moderation panel, and reflects the changes made in the displayed moderation panel by updating the graphical and statistical comparisons.