Absolutely. After several thousand miles, the old oil filter is saturated with the carbon, acids and gunk that were in the old motor oil that you just had changed. Leaving the old filter in place would immediately contaminate the fresh oil you just added.