This should be a PendingDeprecationWarning, and you should add an entry in docs/internals/deprecation.txt.