Do a Dir.chdir in order to not cause IO issues when cleaning tmp/jekyll.