Allow API consumers to remove apps from a collection (bug #894589)

r? @diox @cvan