You can use vinegar with Acrylic paint brushes. For severely caked-on paint, warm up the vinegar using a microwave or stove. Then, rest the paintbrush in warm vinegar for about twenty minutes. Rinse the brush out with warm water and dry it out.