No, it is not difficult, but it does require some side quests to raise your level. If you only do the main tasks, you cannot end the game smoothly, because opponents will certainly get stronger than your level. The absolute level is essential for your victory, even if you can play and have good equipment or not.