Make sure that LANGUAGE line in /etc/default/locale is active (always)