Green olives are the best substitute for capers. Pit them and chop them up into pieces!