Yay, finally identified what kept blowing things up - cases where items were ~same. Now to solve it..
Updated sanity check to also check weights' correctness on every level; and found out the weight calc IS lacking. Sigh.
Added weight sanity checking, and finally found the problems within remove that skewed the weights. Whew.