Fix errors on CI

- We were experiencing errors because we were not cleaning up tests that
  used the DisplayMessage.exit_on_warning! method

Signed-off-by: Bebe Peng <bpeng@pivotal.io>