Realized it's ok to combine the stencil-to-alpha with alpha testing as it's done within the shader, before we replace alpha.