Yes, you can bake the shrimp in a preheated oven at 400°F for about 10-15 minutes flipping halfway through, or until they are cooked through.