Deduplicate message download on poll too.

Notably, we don't want to re-download messages downloaded via IDLE
polling on Inbox via polling on All Mail.