Key metrics for evaluating the success of an AI app include accuracy, precision, recall, F1 score, user engagement, retention rate, and customer satisfaction. These metrics help measure the app's performance, impact, and user satisfaction.