Push and pull won't work without the position set.

Thanks to @ctalkington, see a6d92606c8f094389b0ff0a3598666c7df334dec.