runs_once doesn't work with parallel tasks

Asked about this in IRC, figured it'd be a good thing to document.
Merge branch '1.5'