You may use some of the basic machine learning metrics to evaluate the performance of keyword extractors, such as accuracy, precision, recall, and F1 score.