perhaps instead of removing the fileset (because it may be required), we can use the erroronmissingdir attribute for ant filesets?

    fileset(dir: ...., includes: ....., erroronmissingdir: "false")