Properly handle player kick before PlayerJoinEvent