Both capers and olives have similar taste and even look a little similar, except capers are much smaller. However, they do not come from the same family of plants at all. Olives come from olive trees and capers come from caper bushes.