Conjugate gaze palsy itself is not painful, but patients may experience discomfort from associated symptoms such as double vision or headaches caused by eye strain.