Yes, while rare, conjugate gaze palsy can occur in children, typically due to congenital abnormalities, brain injuries, or neurological diseases like multiple sclerosis.