Don’t die when connecting to a full server.

Fixes an oversight in #6573.
Why validate colors for spectators? I suggest

```csharp
if (slot != null && !server.LobbyInfo.Slots[slot].LockColor)
```

instead.