you have a choice of how to tokenize your input so what let's look at a sentence here subscribe to PewDiePie so this is a sentence and the sentence is rather let's say world wise complicated so why matter language one will have problem with this so first you need to tokenize this sentence alright so what most people do is they say okay here are the word boundaries we're not tokenize this into three segments first is subscribe to piggyback okay so three things and each of these now needs a a word vector associated with it now to