CLC-2289 Second followup: Be more discriminating in what we delete
Merge pull request #1419 from ctweney/clc-2289-followup-qa

CLC-2289 Second followup: Be more discriminating in what we delete