It's easiest to remove the peach pit by slicing open the peach from top to bottom and all the way around, then using your thumb to pluck or push out the pit. If that doesn't work, you can pop the peach on the grill and the heat will loosen the pit.
The most important thing to remember is a ripe peach releases its stone so maybe you have an under ripe peach.