Fix unregistering of event listener

Fix from forums (http://www.minecraftforge.net/forum/index.php/topic,7855.msg40208.html#msg40208) for unregistering of event listeners not working properly because listener caches are not rebuild after removing a listener.