brush masks: small rendering improvement

this fixes a rare rendering issue where brush strokes could have
gaps close to very sharp edges