Remove old files from non-plugins folder