Remove the memory usage for query facts when next time search, or the close of clips