Most people don't want to vote for a party that constantly succumbs to extortion from an extreme faction.
Extreme factions might extort a political party for votes.