testcase updates for max min edge cases

This clarifies the behavour of R.max and R.min where garbage input has been provided.

See #548
:+1: for that test case and the same one for min