Make sure the checked_label_set is only created once, closes #349