Don't tack on delta if its in the future

Some messages get delivered faster than the speed of light (really, there's a
skew in the clocks between the servers).  This should make things *appear* sane
again.