Avoid fetching attachment when the full message has already been fetched