It will rely on elements including your fitness level, the outside temperature, and the water's current. However, if you are interested in kayaking four miles in the shortest time possible, it is recommended that you paddle at a moderate to fast pace and take breaks when needed.