Do not predict labels that do not exist.

Fixes #491.