Tormund hated the Mormonts because Jeor Mormont persecuted the wildlings as the Lord Commander of the Night's Watch. Even after his death, he still despised him and hated everything that had to do with his lineage.