You can use a soundproofing material called Acoustical Panels to cover the walls in your closet. They are easy to install and cost around $10-15 per square foot.