Moved simulation of previous N frames to client