No, the sword hilts are not necessary to complete the game, but they do provide additional abilities and enhancements to your weapons.