Remove old version of FS cache automatically