Apply caulk to all seams and joints of the PVC pipe to ensure a tight seal. This will prevent any water or debris from entering the chimney.