You're very right, it won't be translated.

It's only a problem if we run tests on multiple locales, which we shouldn't be doing.

You can restrict the test, when created, to limit locales. So, the text is already translated. The locales themselves may react differently to locales, so it's best to make sure you test per locale.