Materials: Observe MaterialManifest deletion

To ensure the manifest groups are always valid.