Boxer shorts are often worn with oversize lounge tops, as are leggings and yoga pants. Some women also enjoy wearing denim or cargo shorts with these tops, depending on how comfortable and soft they are.