Network removes peers when disconnected
Make sure to remove everything (like eventlisteners) when removing an entity

I have to admit I don't know exactly when this is required...