Remove /build/ruby-switch during cleanup
Remove insecure key from the app user