Also check ban when inviting a worker