You cannot permit it. Especially with a man with his background. You've tried to get your husband to listen, but, right now he seems unable to. You are likely to get his attention if you spend a few days with your family. In particular, I think you have to make a big stink about pinning you to the wall.
Stress exacerbates everything.
Stress creates chemical changes in the brain and can turn the sweetest person into a monster. If your husband is unable to behave because of the stress, you may want to insist that he deal with it chemically. His internist can prescribe an SSRI to help him through this period, or, you can buy him a bottle of St. John's wort. This one's very fixable. Dr. Irene Material posted here is intended for educational purposes only, and must not be considered a substitute for informed advice from your own health care provider.