When the cookies are done baking, the edges will be set and the middles will look barely done and a little gooey. Not to worry, the cookies will set and finish cooking with the extra time on the baking sheet. This step is key for soft and chewy peanut butter cookies!! If the edges of the cookies are golden brown when removing them from the oven, then they are over baked. They should look a pale and light brown in color.