Turns out Debian wants utf8 specified in the LOCALE.