Question: are the white walkers gilly's brothers?
Answer: Gilly and Sam stole one back, (Little Sam, Gilly's baby). Sam Tarly killed the WW that was sent to get the baby. From the NK's perspective that's like someone just stole one of his sons and killed another. ... So, that is the significance that Gilly's baby is the brother of the White Walkers.