Simplify and increase robustness of Shroud et al. Fixes #3440.
Add an extra sanity check.
Only update vis for actors in the world. Fixes #2726.