No, there is no need to carry an oxygen cylinder if you are medically fit. Kedarnath Temple is located at the altitude of 11,755 ft. if someone feels a problem in taking oxygen then you can consult with the medical team, which is on the way to Kedarnath.