Plexus Archiver proved to be.... ridiculous to say the least. Apache Commons-Compress seems to be a lot better although much more verbose. This will only delete files/directories when they're in the directory so that it supports using worlds named something other than 'world'.