The celebrity chef , who owns a chain of restaurants , pulled out of a scheduled appearance on the Paul O 'Grady Show on Channel 4 at short notice after repeatedly declining to answer questions about the reports of adultery .