We should NOT check if the file was removed for good. If filesystem is failing, worse things will happen.
In Linux if you try to remove an open file, it will succeed, and it will appear as removed for all processes except the one(s) opening the file. After those processes go down, it will be deleted for good.