Figured out that the invisible cannonball was interfering with the instantiated cannonball due to the collider still being active - DOH!  <=== this guy feels pretty dumb it took him all day to realize this.