Yes, most onsens are mixed gender. There is no way to cover up when you are in the bath, so do not worry about being embarrassed or uncomfortable.