Properly clean up router VMs when they're removed from Neutron.

This is something I unintentionally broke awhile back (there wasn't a test for it).