Make new tests reliable
Add changelog entry and docs entry