Don't try to detach a detached node

Test Plan: grunt test