Remove config notifiers when display plugin is unloaded

After the module is unloaded, unexpected things can happen if
stale callback function pointers are left active.

Now all config change notifiers should be removed on plugin unload.