Handle EBUSY on remount

Fixes #5691