Revert "Additional check on loaded chunks : avoid getChunkAt rare exception"

This reverts commit 3efe3c3d3d4f67fc705da160170856f3376a828f.
Revert chunk load change - but still make sure they don't unload under us