Yes, you can use frozen shrimp but they’ll need to be thawed first. To quickly thaw frozen shrimp, you can place them under running cold water.