Mark strings that were causing test failures as unicode

@sarina @feanil 
This is needed for tests to pass when the release branch is merged into master.