Filter UTF-8 chars in English tokenizer



git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinx4@12569 94700074-3cef-4d97-a70e-9c8c206c02f5
Some more testcases



git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinx4@12570 94700074-3cef-4d97-a70e-9c8c206c02f5
Remove interfaces with a single implementation.

git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinx4@12571 94700074-3cef-4d97-a70e-9c8c206c02f5
More quotes to filter



git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinx4@12572 94700074-3cef-4d97-a70e-9c8c206c02f5
One more dash



git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinx4@12573 94700074-3cef-4d97-a70e-9c8c206c02f5
Extract interface of sequence aligner.

git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinx4@12574 94700074-3cef-4d97-a70e-9c8c206c02f5
Use Needleman-Wunsch algorithm to get results.

git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinx4@12575 94700074-3cef-4d97-a70e-9c8c206c02f5