Fix regression in house loading

This was causing house loading to take over 4 seconds with default map.
Average startup time with default datapack is now 1 second instead of 6
seconds.