Revert "When not using co-masters fetch _all_ files"

This reverts commit 265b03ed6e5a5bc73446aab4d3b630d08e7fcb56.