Upgrading to higher rarity gear will increase your damage output allowing you to kill enemies even faster! But it's not mandatory.