Work around esoteric bug in reload of site package

Fixes #15647