In short, no, you can’t. Child support and visitation are not mutually exclusive — they’re completely separate from each other. Even though your ex isn’t paying child support, he or she still retains visitation rights.