Discard Huffman trees for extremely uncommon symbols.