Perplexity measures how well a training model predicts a given sequence of words. It helps evaluate the model's ability to assign probabilities to a set of words, making it a useful evaluation metric.