Conversation so far:
When did Jesse first come under criticism?
when he decided not to live in the governor's mansion during his tenure.

Question: Who was criticizing?
Self-contained rewrite: Who was criticizing Jesse Ventura?