Make a best effort to clean up