Don't alternate the purpose of server.accept

This originated as an attempt to fixed #2, #4, but it didn't help.
However, I think it's a good idea anyway in order to prevent the
alternation potentially getting out of sync.