Since the final model is estimated only from the inliers, I tend to prefer scoring only inliers here. Additionally, few outliers can strongly distort the score, but the purpose of RANSAC actually is to robustly estimate models from faulty data. What is you motivation to score all data?