Backport 1.8 gh 4518

Fixes #4486: `Core dump and SystemError when casting from and to high-precision datetime64 objects, respectively`