You should wash your red potatoes to remove any dirt from the surface. However, whether or not you peel them is your own choice. I would advise you to leave the skin on and not peel them. The skin contains a lot of nutrients. It also crisps up while it cooks in the oven, giving the roasted asparagus and potatoes a lovely texture.