Should throw IOException if fail to rename the jar directory.