No, you don't need to swim while hiking The Narrows. Most of the water sections are ankle to waist deep. However, there might be deeper sections depending on conditions, but these can usually be navigated without swimming.