Speed up by not refining masked out pixels.

Skips pixels that have a zero prior UV value.