Don't keep anything you don't love. The best way to approach cleaning out your closet is to look at each item individually. If it doesn't fit, is out of style, is worn out, or you just don't love it, get rid of it. If you don't love a piece, you're going to end up never wearing it, so it will just take up space in your closet.