Avoid changing actual width of the number column with each jump between number and relativenumber

This is a feature request with a quick demonstration of what I'd like, but it's probably inefficient.

The feature is relevant for files of 1000 lines or more (unless you changed your numberwidth from the default of 4, in which case you'd probably know why it's relevant anyway).

(TBH, this feature should probably be in vim proper)