Absolutely!  If you are making this cake during peach season I recommend it. Ripe fresh peaches add such a sweet flavor. You can also use frozen peaches and still get a wonderful peach cake.