Don't allow invisible groups to moderate boards (fixes #450)

Signed-off-by: Michael Eshom <oldiesmann@oldiesmann.us>