novelty score bug