Release the lock on classpath dirs while renaming / deleting / moving, closes #106

There are probably more places where this needs to happen.
In another PR @elsassph agreed that try/finally should be used.