Add dismiss option for missing checkout page notice

Fixes issue #2099