If the court allowed for visitation and your son's father has not visited your child, you need to file a contempt order. He has a right to still enforce the order if you have not made attempts to amend it due to his violation of the order. You should consider what is in the best interests of the child and if that means filing a contempt motion to prevent him from seeing your son, then you should pursue it.