Restore to previous BoW