Seem to have bundle adjustment working fine, tracking gets lost when big scale changes are made