Do not handle signature parts after verification

Since signatures are not listed as attachments there is no reason to
handle them after the verification.