Remove cached ssh connections when destroying vms during testing.