Looks like it was just because we were passing includePackages = false sometimes, just not all the time - enough to confuse me while debugging. :(