No, you should not use jelly in your thumbprint cookies. Jelly tends to run over the tops of the cookies while baking.