Fixed race conditions with multiple participants

It wasn't working with more than 2 participants, we were applying changes from people twice and then sending out an update. Was very messy.

Also removed all notion of clients, not sure what they're used for but sending them in JSON was giving circular JSON errors.