LUCENE-5577: the cleanup code didn't cleanup after itself...

git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/branches/branch_4x@1585052 13f79535-47bb-0310-9956-ffa450edef68