Some portions of the Census Returns from 1841 to 1911 have been lost over the years, so it may be that your ancestor was living at an address contained in one these missing portions. The most missing pages are from the 1861 Census. It is possible peruse a full list of the missing portions from all the Census Returns.