Remove ~/.vim directories from the runtimepath

This avoids loading plugins, which might cause errors.