Yes, there are hot shower facilities in the teahouses. However, do not expect it to be too warm. Also, it may cost you some amount like $3-5 per shower.