Do not update mesh in shadow pass.

It may introduce some 1 frame latency between shadows and geometry but
in practice it's not noticeable.