To understand the phrase, "I want a word with you", means that I want to have a talk or discussion with another person.