You don't need to get ascended gear unless you want to run high-level fractals (in which case you need the infusion slots). However, it's a good long-term goal, especially if you plan to play WvW or do raids.