BUG: don't try to deal with a dead cache referant (GH5216)

closes #5216