Whether you remove the tails or leave them on is entirely up to you. Leaving the tail on the shrimp is a more traditional way to serve Trinidad pepper shrimp, and it adds extra flavor to the sauce, but you won't miss it if you leave them off.