added way to not process high missing data repofiles.