Fix memory issue caused by prematurely deleted DescriptorPool