Try to get the busyobj refcounting more right