When Broly and Goku were infants, little Goku kept baby Broly awake by crying at night. As a result, Broly used to cry too, which caused him to hate Goku.