No, you do not need a permit to kayak in NY. Kayaking is considered a non-motorized boating activity, so as long as you have the proper safety equipment, you are good to go!