Woops, don't use internal position when we're using an external cell based system.
GameObject collision works, but due to model limits, destructable GameObject models really don't work, but it looks like the map files do a forced check on certain spawn locations anyway.