Only worry about tau for measured fluxes, not upper limits