Finally figured out why RA4 wasn't working, was set as an analog input.