I wouldn't recommend leaving out the capers. I think they add the perfect layer of flavor to this dish. If your kids are against them, I would still use them and serve the chicken to the kids without them.