Actually fix issues with per-world permissions