Don't walk over VPs in normal mode.

Debug code should only run when debugging is enabled
Handle replies from virtual servers, too