Know the Past, Find the Future