Calling garbage collection resolved the windows delete issue.  Apparently it is a Java bug.