Set LC_MESSAGES too.
Test against 5.4 and 5.5 too.