Wrote .c file to test tokenize.c
Tokenize.c needs to include it own header
Added header guards to tokenize.h
Added <ctype.h>
Added length-checking to get_token
Change TK_* to use #defines instead of an enum
Fixed major problem
compile.sh will now commit #includes as well as source files

Sadly, it's not yet recursive
Initialized 'i'
Removed dumb warning
ungetched critical charecters
Fixed bug where symbols after /[-+]/ didn't get read
Fixed another /[-+]/ related bug
Add vim syntax for this stuff
Experiment with hash tables
Compile all these easily
Testing new getop
Fixed syntax error
Added thing
Modified this