Basic Tokenisation

Not a lot done this week, thanks to deadlines. However, this code will
take a string of free text and return tokens. Many of these tokens will
have to be recombined later for words containing punctuation, as well
as multi-word entities (fruit fly? Victoria sponge?)