It is extremely important that both of you seek personal consultation with a marriage and sex counselor. There are many more details needed from both of you before any advice can be offered. However, prima facie, it appears that your husband may be suffering from a problem like erectile dysfunction and hence trying to avoid sexual encounters with you. He surely needs a lot of counseling and treatment of his problem.