sebastianbergmann/phpcpd — pull request #83 by aboks (2013-10-27 15:24:20+00:00)
Title: Decoupled tokenizer from detection strategy

This opens up possibilities to swap the default token_get_all()-
based tokenizer for another one, or to add tokenizers for other
programming languages.