No, the fish will be just fine to serve with the skin on. Just make sure the skin is on the bottom and not the top. Like above, it's pretty easy to avoid eating the skin when taking bites from the top of the fish.