Track and Delete installed configurations