We actually want to mark players invisible IF they are invisible
Handle vanished players