tweaks to handle missing data