Make sure modules run their fullUnload before their modes are removed
This is definitely up for discussion, though some kind of change was needed
as unsetting modes when their chars were already removed did not work.
Ensure non-core modules unset their modes when they are unloaded