This one-pan recipe is an excellent way to use bags of frozen shrimp. Technically, you can cook shrimp in the oven directly from frozen, but for the best results, thaw the shrimp in the fridge overnight or place the bag under cold running water until defrosted.