Patent Document ID: 9122679
Application ID: 13729743
Patent Status: 1

Claim One:
1. A method for a server computing system, comprising: determining, by the server computing system, a plurality of statistics for a plurality of validation documents; determining a number for a sample size of test documents in a plurality of test documents based on the plurality of statistics for the plurality of validation documents and an effectiveness measure of interest; determining, by the server computing system, a plurality of statistics for the plurality of test documents, wherein a number of test documents in the plurality of test documents is the number for the sample size of test documents; determining a number of false negatives for a corpus of documents based on the sample size and one or more of the plurality of statistics for the plurality of test documents, wherein a document of the corpus of documents is a false negative if classification of the document by a classification model is negative and classification of the document by a user is positive; and calculating, by the server computing system, an effectiveness of an information retrieval system on a corpus of documents based on the number of false negatives for the corpus of documents.