Onsens in Japan are naked only. There is no way to cover up or hide with a towel, so do not worry about being "over-dressed." I wouldn't recommend wearing anything besides your bathing suit if possible, as this will become unnecessary when you get wet and take it off for the bath.