Yes, you can bake the coconut shrimp for a healthier alternative. Place them on a baking sheet lined with parchment paper and bake at 425°F (220°C) for about 12-15 minutes, or until golden and crispy.