Make ranker more flexible (prefix tokenisation)