Do you have to drive it to see it?
No. You can pull in at the parking area (see out map above) and soak up the views from there without actually driving Conor Pass itself.