Neoprene wraps are made for this exact purpose. They don’t suck up water and dry quickly again. Other fabrics react like normal clothes: After being exposed to the water they remain wet for a while.