Two bug fixes:
Reconnecting was broken (state wasn't properly updated)
Shouldn't decline invites we don't want. Just don't handle them. (Not sure if this is correct, but declining doesn't seem to work so trying this for now?)