That's what testALS() does.  Monkey see, monkey do.  (I can compute RMSE instead, of course; but any fragility here you'll also find in testALS.)