Green olives are the best substitute for capers; they're brined in a salty mixture like capers. Chop the pitted green olives and use them in place of capers.