require UTF-8 encoding in more places
specify UTF-8 encoding in Scanner
line break support
specify UTF-8 encoding in Scanner
line break support
use apache URL decoder - sun's version threw errors in edge cases
explicitly check for URL validity
updated test to match change in processor contract - return each url at most once
changed test log to 400 from 404.
factored out creation of a decent scanner to new test utility class
Merge branch 'STREAMS-242'
Merge pull request #18 from apache/master

Merge Apache Master 2014/12/08