Raise an exception on unknown speech/silence labels.