api: prevent unlock on unit-remove
app: run remove units in background
service/bind: fix tests broken by the FakeProvisioner

See 61c8b4d3b5e7fa1989fe8c438a13a43f8061ca61 for more details on the
change.