Don't unload manager if its null.

Change-Id: I888bb0201d365b36a02a363ba11bc1a49051a24f
Reviewed-on: http://gerrit.dmdirc.com/3406
Automatic-Compile: DMDirc Build Manager
Reviewed-by: Chris Smith <chris@dmdirc.com>