Might be a good idea to just always set the not modified header if we can