Add support for delete vm networks on vsm