Cut down on a debug check in release mode.

In Jewel Summoner, for example, this gets called a lot, and eats a
measurable percentage of time.