Yes, you would have to remarry, since in the U.S., no person can be married to more than one person at a time, and the earlier marriage "wins"--so if he was still legally married at the time you and he wed, you did not actually marry.