If your pillow or pillowcase starts to turn yellow, it's time to wash it. You can also tell if you need to clean it if your pillows have a sour or musty smell.