Cache the siblings size too.