a reputation system for selling human computation
We describe a reputation-driven market that motivates human computation sellers (workers) to produce optimal levels of quality when quality is not immediately measurable and contracts specifying the level of quality cannot be enforced. We consider the implications of making quality instantaneously verifiable up to a known threshold ("partial verification"), as might be the case when the market maker possesses a sufficiently advanced artificial intelligence apparatus. We find that such a verification system allows the market to attain a Pareto optimal equilibrium with less patient workers, and, in addition, makes the market more resistant to pseudonym attacks.
reputation systems human computation feedback contract theory adverse selection trust moral hazard