remove use of recycled set in filters eviction

yea, another cleanup is never scheduled until the first one ends