Update balls even for worse rect matches.