You've been entertaining a celebrity unawares, I replied.
You've been unknowingly taking care of a celebrity.