appliance: Use 'rm -f' on files which might have been moved so might not exist.

This partially reverts commit fae4a2cfb99bab26f3bd60f52e4a586e39f54f49.
release notes: Don't document new internal APIs.
Version 1.21.40.