Erase palette when freeing it

To make use-after-free more obvious