Just give it a good stir with a spoon. Alternately, if you have an immersion blender that fits inside of the jar, you can place that in the peanut butter, hold the jar, and pulse a few times to blend it back together and help the oil re-incorporate.