Yes, you absolutely can! Using chunky peanut butter will just give the muffins a bit more texture with the peanut pieces.