Yes, removing the excess fabric will make the pants more comfortable, and it will help the tapering stay in place.. You can trim it away with scissors. Just be sure you don't accidentally cut into the stitching.