Fix even more issues with replacing the WorldProvider

Nether portals work again :smiley: