Broly has been seen toying with Super Saiyans almost double the power level of any character in the Naruto universe. It stands to reason that Madara would barely be able to scratch Broly, let alone take him down in a fair fight.