ArchiveTeam/mobileme-grab — pull request #1 by qwrrty (2012-03-02 18:41:42+00:00)
Title: faster code for creating directory structure

The code in dld-me-com.sh for pre-building the directory structure uses bash pattern matching and forks several processes for each line in urls.txt. On a large user account this can add up to quite a lot. Using perl to generate the list of directories and piping the result into xargs speeds it up by about two orders of magnitude (on a user with 14K URLs to mirror, the amount of time to create the directories went from 13 minutes to 6 seconds on my workstation).

This perl should be portable across platforms, for what that's worth, though I have no Windows machine to try it on.