Allow removal of registries

* Changes behavior to allow removal of a registry after it has
  been added to application registry.

Signed-off-by: Lars Holm Nielsen <lars.holm.nielsen@cern.ch>