rawdenoise: don't take sqrt of a negative number

(and expect real results)