Initial commit
added tests based on the data file. the test number is the line in the file
more complete parsing
issues with url parsing in tweets
extending tokeniser to more twitter elements and associated tests
added more examples for testing
Merge branch 'master' of github.com:middlet/twit_tok

Conflicts:
	examples/simple.tweets
	tokenise.py
	tokenise_test.py