Fix a critical bug in R.mathMod

The wrong argument of `mathMod` was being checked for being less than 1. As a result, it was not actually computing values as advertised.