Get the Past Out of the Future