Add an extra sanity check.
Only update vis for actors in the world. Fixes #2726.