Yes! Always. The orange peel can contain oils that might lead to some nasty indigestion, not to mention that it's not especially tasty! However, if you're using a manual juicer, it makes sense to keep the skin on as the reamer will only interact with the fruit's flesh and will give you a better grip on your oranges.