Can't remove a character from an all-chars grant

This is a band-aid, but it's okay for now given the two existing call
sites.
Merge pull request #372 from jboning/bugfix/all-chars-remove

Can't remove a character from an all-chars grant