Delete language-specific paths to allow using quick_delete() on nested paths