patch.js should contain server directories after all

After careful consideration (and a corresponding re-design of the client side downloader), that one argument against it felt pretty weak in comparison.