Make sure to unset the module load/unload handlers properly.