I think you will have a hard time convincing a judge that the children should not see and have a relationship with their dad.  If he is a danger to them, and you can prove it, you'd have a better chance, but I don't think the reasons you have given will be sufficient.  Speak to a family law attorney in your area.  The best you might be able to do here is to have court-supervised visitation.