Release the lock on classpath dirs while renaming / deleting / moving, closes #106

There are probably more places where this needs to happen.
I think it's too expensive, anyway? There was a noticable delay when I tried that, but then again, that was in a debug build...