tokenizer recognizes functions
added test
supporting functions
refactored
Merge pull request #1 from elclemente/functions

Functions