Allow manager to be set even when a department has no members

This is necessary to allow for creative department based access control and
alerts.