added nub_by