Yes, it is recommended to remove the orange peel before feeding it to your rabbit. The peel of an orange can be tough and difficult for rabbits to digest, and it can also contain compounds that are toxic to them. Removing the peel and seeds before feeding will help ensure that your rabbit has a safe and enjoyable experience when eating oranges.