Release the lock on classpath dirs while renaming / deleting / moving, closes #106

There are probably more places where this needs to happen.
Yes, this. I mean try/finally pattern.