Use two render pass.

First, render to YUV.
Then, render to differences using the YUV texture and the original.
Slightly faster, but still far from perfect (duplicating lot of steps).
Experimenting.