[1.7.x] Added a warning about direct settings manipulation in tests.

Thanks Thomas Chaumeny for the initial patch.

Backport of 3f651b3e88 from master