Convert more things to world coordinates

Mostly refactoring in preparation for projectiles (#3434).
The only expected functional change is to Leap (see 9adafcb description).