Question: are olives in the nut family?
Answer: It is a fruit. A nut is merely the kernel of a fruit. If you wanted to crack the shell of the seed of an olive and extract the kernel you would be welcome to call that a nut I am sure, but I don't think you would get very good flavour. You might get oil out of it.