Patent ID: 9705896
Date: 2017-07-11
CPC Classifications: G06Q,H04L

Claim:
1. A computer-implemented method comprising: determining, by a computing system, a plurality of model scores associated with a set of accounts, each model score in the plurality of model scores being associated with at least one account in the set of accounts, the set of accounts constituting online accounts with a social networking system; ranking, by the computing system, the plurality of model scores in descending order; determining, by the computing system, one or more metrics associated with each model score in the plurality of model scores based on information about the at least one account associated with each model score, wherein the one or more metrics are associated with at least one of a running total quantity of accounts associated with each model score and all higher model scores, a running total quantity of disabled accounts associated with each model score and all higher model scores, or a running total quantity of active accounts associated with each model score and all higher model scores; acquiring, by the computing system, specified criteria selecting dynamically a model threshold utilized in identifying illegitimate accounts, the specified criteria being based on at least some of the one or more metrics and associated with at least one of a precision rate for identifying illegitimate accounts, a recall rate associated with identifying illegitimate accounts, or a false positive rate associated with identifying illegitimate accounts; selecting, by the computing system, the model threshold as corresponding to a lowest ranked model score that satisfies the specified criteria; and disabling, by the computing system, at least one account in the set of accounts based on a model score associated with the at least one account that satisfies the model threshold.