Fix sync'ing multiple dirs with single source

We push into the stack UNLESS in recursive mode. Can't believe
this was broken for so long before I noticed it...