Don't depend on unloaded worlds

Fixes #10