[CS] Don't try to require a file we just deleted