Revert "Add a sanity check to the free_work wrapper to prevent it trying to erase a NULL pointer"

This reverts commit 34788c2c73c5885d1333791f2478e35b38ae1eca.

Broken