Symbol contents aren't restricted to <byte-string>, so when we have unicode this won't be totally correct.  On the other hand, it's so unlikely to be an actual problem that I wouldn't worry about it.

Personally I would be happy just using <byte-string> and disallowing symbols.  hannes likes having symbols.