It's easy to take on Geirmund Hall first since you have to go to Ivarstead early into the main quest and likely wander over to Geirmund's Hall. Sigdis' brothers are noticeably easier to take down, so it's up to you. Spoiler alert without being a complete spoiler, this won't be the last time you run into Sigdis anyway.