Release the lock on classpath dirs while renaming / deleting / moving, closes #106

There are probably more places where this needs to happen.
Is this should be in try/finally block?