It is entirely possible that in a dispute between parents concerning matters that one can deny the other visitation with the minor children when there is a restraining order in effect. Whether such violates the restraining order depends upon what the order states. From what you have written I suggest that you consult with a family law attorney for assistance.