When changing the mountpoint of an external storage, ensure the old one ...

...is removed

Fixes #4557 

cc @PVince81 @bantu