Release the lock on classpath dirs while renaming / deleting / moving, closes #106

There are probably more places where this needs to happen.
Here the same question about try/finally.