Unfortunately, yes. However, by filing for innocent spouse relief in a timely manner, you may be able to qualify for special consideration, if the federal government determines that you were not responsible for your husband's tax mistakes.