tests: make FakeServer.destroy more graceful