While swimming with a dog alongside you in open water can be safe, it's not recommended for dogs that are not used to paddling. If your dog is new to kayaking, consider kayaking with him in one of the kayak's cockpits.