You are quite reasonable in thinking this and for your children's safety, you want to make sure this person doesn't do something criminal. Be proactive and do background searches if you need to but at the outset, take your ex wife back to court and see if you can amend the order so that she is prohibited from bringing this person to your place of residence and that you make sure your children are safe.