Yes you can! Doing this will result in an amplified spiciness that increases more and more overtime. So if you can handle the heat, feel free to leave them in.