I had seen very little of him for some years.
I did not see him much for quite a few years.