missing data in irods so use warehouse primarily