Yes, you can eat the skins of baked russet potatoes. This is actually a very nutritious part of the potato.