Swimming pool houses don’t have to have bathrooms, but one can be installed for about $15,000 to $35,000 on average. This cost is due to the extra work required to run plumbing and electrical and to install fixtures.