ENH: memorize rejection across views