Fixed step simulation "antighost" fix

we were switching buffers without having done changes, giving undefined
behavior