First, clean your closet well and vacuum everywhere. Get rid of or treat anything that is infested. You should also consider using insect-killing sprays or powders specifically for Silverfish. Then, you should apply caulk along the baseboards where these insects may be getting in. Most importantly, keep your home dry! Silverfish love moist areas where they can find a food source.