You sure can! I recommend thawing the shrimp beforehand. You can quickly thaw frozen shrimp by placing them under running cold water.